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EXECUTIVE  SUMMARY 


The  goal  of  initial  provisioning  of  spares  for  a  new  weapon  system  is  to 
provide  an  acceptable  level  of  readiness  at  least  cost,  or,  conversely,  to 
provide  the  highest  level  of  readiness  for  a  fixed  level  of  investment.  One 
fundamental  provisioning  issue  is  the  mix  of  spares  to  be  procured.  Tra¬ 
ditional  methods  determine  the  mix  of  spares  without  considering  readiness. 

Mathematical  models,  called  availability  models,  developed  in  the  last 
decade,  make  explicit  the  critical  link  between  readiness  and  the  cost  and  mix 
of  spares.  Their  use  within  DoD  has  not  been  required  and  is  still  sporadic; 
however,  the  Secretary  of  Defense,  in  the  FY84  Defense  Guidance,  provided  the 
following  direction  to  the  Services: 

"Our  objective  is  to  size  and  fund  POS  secondary  item  inventories  to 
support  programmed  weapon  system  availability  rates  and  operating 
tempos.  ...  the  Services  will  develop  and  institute,  by  end  FY84, 
the  ability  to  size  weapon  system  initial  and  replenishment 
secondary  item  inventories  to  meet  explicit  weapon  system  avail¬ 
ability  and  operating  tempo  objectives." 

Availability  models  are  superior  provisioning  tools  because  they 
explicate  the  readiness-to-investment  link.  Using  an  availability  model  to 
compute  the  best  mix  of  spares  for  a  specified  provisioning  budget  should 
substantially  improve  the  readiness  of  new  systems.  Conversely,  using  one  to 
compute  the  best  mix  of  spares  to  achieve  a  desired  level  of  readiness  should 
keep  to  a  minimum  the  cost  of  provisioning  a  new  system. 

To  test  that  hypothesis,  we  examined  the  provisioning  history  of  the  F-16 
and  the  aircraft's  first  30  months  of  operational  experience. 

First  we  investigated  the  accuracy  of  initial  estimates  of  component 
characteristics--the  estimates  upon  which  provisioning  calculations  are  based. 
Results  were  mixed.  Price  estimates  were  remarkably  accurate,  but  estimates 
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of  component  removal  rates  (called  maintenance  factors)  averaged  four  times  as 
high  as  their  observed  values  in  the  30  months  of  operation.  The  consequence 
was  an  F-l6  availability-vs . -cost  curve  that  overstated  the  spares  expenditure 
required  to  achieve  the  availability  objective.  We  conclude,  therefore,  that 
the  use  of  initial  estimates  to  compute  an  availability-vs . -cost  curve  should 
be  coupled  with  an  effort  to  detect  and  eliminate  any  systematic  bias  in  those 
estimates . 

Second  we  investigated  how  best  to  compute  spares  requirements  once  an 
investment  level  is  specified.  The  answer  is  clear:  use  an  availability 
model.  The  resulting  mix  of  spares  will  provide  substantially  better  weapon 
system  availability  and  will  be  less  vulnerable  to  uncertainty  than  will  the 
mix  calculated  using  traditional  methods.  We  recommend  that  DoDI  4140.42  be 
revised  to  require  the  use  of  availability  models  for  this  purpose  for  all 
new,  major  weapon-system  programs. 

Exploring  further  the  problem  of  biased  initial  estimates  of  component 
removal  rates,  we  found  that  it  can  readily  be  overcome  with  operational 
experience.  Based  on  F-16  data,  revision  of  estimates  on  the  basis  of  as 
little  as  one  month's  experience  can  greatly  improve  provisioning  decisions, 
increasing  readiness  or  reducing  cost.  Revision  based  on  six  months'  experi¬ 
ence  is  almost  as  good  as  that  reflecting  thirty  months'  experience.  It  is  an 
expensive  mistake  to  postpone  revising  initial  estimates. 

The  method  we  developed  for  revising  estimates  is  called  BAYES-LIN.  In 
the  F-16  application  it  proved  far  superior  to  the  weighting  factors 
prescribed  by  DoDI  4140.42.  The  BAYES-LIN  method  should  be  tested  on  other 


As  "real-world"  availability  we  used  the  availability  calculated  from 
maintenance  factors  (i.e.,  component  removals)  observed  in  the  F-16  program 
from  July  1979  through  June  1981. 
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weapon-system  programs.  If  its  success  is  repeated,  it  should  be  substituted 
for  the  method  now  prescribed. 

In  summary,  our  experience  with  data  from  the  F-16  program  illustrates 
the  dramatic  improvement  that  new  mathematical  tools  can  make  in  initial 
provisioning  decisions.  Using  availability  models  and  techniques  for  exploit¬ 
ing  data  from  early  operational  experience  can  markedly  reduce  the  cost  of 
attaining  desired  readiness  levels  for  new  systems  or,  conversely,  increase 
the  readiness  attained  for  a  given  level  of  spares  investment.  We  recommend 
that  the  ASD(HRA&L)  change  DoDI  4140.42  to  foster  use  of  the  new  tools.  We 
also  recommend  that  he  sponsor  or  otherwise  encourage  development  and  testing 
of  such  methods  as  BAYES-LIN,  to  take  better  advantage  of  data  available 
during  the  early  life  of  new  systems. 
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1 .  INTRODUCTION 


BACKGROUND 

The  analysis  described  in  this  report  is  intended  to  provide  a  better 
understanding  of  how  to  devise  a  spares  acquisition  strategy  for  a  weapon- 
system  program  that  will  provide  an  acceptable  level  of  weapon-system  avail¬ 
ability  during  the  system’s  early  life  for  the  least  expected  total  cost.  The 
terms  availability,  end-item  availability,  weapon-system  availability,  and 
aircraft  availability,  used  interchangeably  here,  mean  the  probability  that  an 
end  item  (for  our  purposes  an  aircraft)  selected  at  random  is  not  waiting  for 
a  component  to  be  repaired  or  shipped  to  it.  (We  do  not  mean  spares  avail¬ 
ability,  fill  rate,  or  supply  effectiveness  rate.)  Throughout  this  report,  we 
focus  exclusively  on  recoverable  (repairable)  items  and  ignore  engines,  common 
items,  and  consumables. 

A  spares  acquisition  strategy  involves  a  sequence  of  decisions: 

a.  Determination  of  required  levels  of  readiness  (as  reflected  by 
weapon-system  availability) . 

b.  Determination  of  spares  investment  levels. 

c.  Estimation  of  component  characteristics. 

d.  Computation  of  spares  requirements. 

e.  Revision  of  initial  estimates  of  component  characteristics  based  on 
early  operational  data. 

f.  Selection  of  the  method  of  spares  procurement. 

The  determination  of  the  appropriate  availability  levels  for  a  new  weapon 
system  is  outside  the  scope  of  this  report,  as  is  the  method  of  spares  pro¬ 
curement;  however,  we  do  examine  each  of  the  other  four  components  of  a  spares 
acquisition  strategy. 
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This  work  is  part  of  a  longer-range  LMI  research  program  in  initial 
provisioning.  An  evaluation  of  an  important  spares  procurement  technique, 
known  as  spares  acquisition  integrated  with  production  (SAIP) ,  is  contained  in 
[2].  Extensive  discussion  of  topics  c  and  d,  above,  may  be  found  in  [1]. 
From  this  analysis  we  derive  important  conclusions  on  the  use  of  availability 
models  to  compute  spares  requirements  and  on  methods  for  revising  estimates  of 
component  characteristics  based  on  early  operational  data  (topics  d  and  e, 
above).  Reference  [1]  concludes  that  availability  models  are  useful  in 
determining  spares  investment  levels  as  soon  as  component-level  data  are 
available,  even  if  those  data  are  only  estimates.  The  current  work,  based  on 
actual  computations  of  availability-vs . -cost  curves  for  the  F-16  aircraft 
system,  leads  us  to  some  observations  about  the  investment  level  problem.  We 
discuss  this  issue  in  Chapter  3. 

THE  CURRENT  WORK 

This  analysis  extends  our  investigation  into  the  application  of  avail¬ 
ability  models  to  initial  provisioning.  We  define  an  availability  model  as  a 
mathematical  model  that  maximizes  end-item  availability  for  a  specified  spares 
investment  level,  or  minimizes  spares  investment  level  for  a  specified  level 
of  availability.  The  remarks  made  about  availability  models  throughout  this 
report  also  apply  to  optimization  models  that  minimize  expected  (time- 
weighted)  backorders  for  a  specified  cost  since  they  compute  nearly  identical 
mixes  of  spares  within  a  given  weapon  system,  as  long  as  those  models  can 
readily  produce  availability-vs . -cost  curves.  The  particular  availability 
model  used  to  support  this  analysis  was  developed  by  LMI  and  is  known  as 
VARI-METRIC.  This  model  was  chosen  because  it  is  the  only  availability  model 
that  explicitly  accounts  for  uncertainty  by  assigning  a  probability  distribu¬ 
tion  to  initial  estimates  of  failures.  It  is  documented  in  summary  form  in 
Appendix  A. 
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An  availability  model  produces  an  availability-vs . -cost  curve,  each  point 
of  which  is  an  optimum  in  the  sense  that  it  represents  the  maximal  avail¬ 
ability  for  that  investment  level  and  the  least  investment  required  for  that 
level  of  availability.  There  is  a  specified  stockage  posture  associated  with 
each  point  on  the  curve.  By  stockage  posture  we  mean  a  set  of  stock  levels  by 
component  and  location. 

The  current  work  examines,  to  some  extent,  the  four  components  of  a 
spares  acquisition  strategy  that  we  enumerated  on  page  1-1.  We  briefly  dis¬ 
cuss  here  the  issues  we  examine  in  this  report  with  respect  to  those  four 
components . 

Determination  of  Spares  Investment  Levels 

In  our  past  assessment  of  the  usefulness  of  availability  models  in 
initial  provisioning,  we  suggested  that  the  decision  regarding  the  appropriate 
level  of  investment  for  initial  spares  should  be  supported  by  an  availability- 
vs.-cost  curve.  In  this  report,  we  do  not  examine  specifically  the  issue  of 
determining  the  initial  spares  investment  level  because,  in  the  F-16  case, 
that  level  was  established  prior  to  the  availability,  in  January  1977,  of 
component-level  data.  We  do,  however,  offer  some  observations  on  the  useful¬ 
ness  of  the  availability-vs . -cost  curves  computed  from  those  initial  estimates 
for  determining  investment  levels  for  future  procurements  of  initial  spares. 

Estimation  of  Component  Characteristics 

In  Chapter  2  we  compare  the  initial  estimates  of  F-16  component 
maintenance  factors  and  unit  prices  with  their  observed  values,  and  discuss 
some  of  the  implications  of  those  differences.  We  also  discuss  in  Chapter  2 
the  availability  of  specific  elements  of  data  at  various  times  during  the 
early  life  of  the  F-16  and  comment  on  the  quality  and  utility  of  those  data. 
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Computation  of  Spares  Requirements 


In  Chapter  3  we  investigate  the  usefulness  of  an  availability  model 
in  computing  spares  requirements  (i.e.,  the  stockage  posture  for  a  specified 
investment  level)  for  the  F-16  and  compare  the  performance  of  such  a  stockage 
posture  with  the  stockage  posture  that  results  from  the  item-oriented  approach 
prescribed  by  Air  Force  Logistics  Command  Regulation  (AFLCR)  57-27,  the  Air 
Force's  implementation  of  DoDI  4140.42. 

Usefulness  of  Early  Operational  Data 

Since  the  need  exists  in  most  major  programs  to  compute  requirements 
for  additional  procurements  of  initial  spares  after  the  initial  operational 
deployment,  an  important  question  exists  regarding  the  usefulness  of  early 
operational  data  in  revising  initial  estimates  of  component  characteristics  so 
that  such  computations  could  be  done  more  intelligently.  We  show  in  Chapter  4 
that  early  operational  data  are  indeed  useful  for  this  purpose. 

Finally,  in  Chapter  5,  we  summarize  our  conclusions  and  offer  recom¬ 
mendations  that  we  believe  would  enhance  the  cost-effectiveness  of  initial 
provisioning  throughout  the  DoD. 
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2.  LESSONS  LEARNED  FROM  F-16  INITIAL  PROVISIONING 


INTRODUCTION 

The  F-16  program  was  chosen  for  this  case  study  because  the  program  is 
recent  and  data  were  available  in  sufficient  detail  to  support  the  study. 
Furthermore,  the  program  has  been  in  operation  long  enough  to  have  meaningful 
maintenance  data  on  which  we  could  base  our  evaluation  of  alternative  spares 
acquisition  strategies.  A  description  of  the  F-16  program  and  its  initial¬ 
provisioning-related  milestones  are  included  in  Appendix  B. 

The  lessons  learned  from  our  examination  of  F-16  data  can  be  summarized 
as  follows: 

-  Early  price  estimates  were  quite  accurate;  for  20  SAIP  items,  the 
actual  prices  paid  averaged  nine  percent  lower  than  the  estimated 
price  using  constant  1976  dollars. 

-  Early  maintenance  factor  estimates  were  far  from  accurate;  the  average 
of  the  ORLA  maintenance  factors  was  about  four  times  as  large  as  the 
average  of  the  observed  maintenance  factors. 

Both  of  these  lessons  will  be  discussed  in  this  chapter,  but,  first,  we  des¬ 
cribe  the  evolution  of  data  in  the  F-16  program. 

F-16  COMPONENT-CHARACTERISTIC  DATA 

Initial  provisioning  is  typically  done  at  a  time  when  the  end  item  (air¬ 
craft)  is  still  changing.  Engineering  changes  are  being  made,  item  character¬ 
istics  (maintenance  factor,  unit  price,  etc.)  are  changing,  and  perhaps 
deployment  plans  and  other  system-level  characteristics  are  not  yet  finalized. 
In  spite  of  this,  the  need  exists  to  provision  for  spares  to  support  training 
and  readiness  requirements.  The  funding  cycle  and  procurement  leadtime  for 
most  recoverable  items  are  such  that  decisions  on  the  levels  of  spares  invest¬ 
ments  and  the  mixes  of  spares  to  be  procured  must  be  made  three  to  five  years 
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before  the  first  end  items  are  scheduled  for  delivery.  There  is  obviously 
some  uncertainty  about  any  data  that  exist  several  years  before  operational 
use  of  the  weapon  system.  It  should  also  be  noted  that  changes  can  and  do 
occur  in  both  the  level  of  spares  investment  and  the  mix  of  spares  procured 
after  the  original  investment  decision  and  requirements  computation. 

Portions  of  data  available  at  various  stages  of  the  F-16  program  are  used 
in  this  analysis.  The  data  are  described  to  indicate  the  difficulty  of  main¬ 
taining  accurate  component  level  data.  Over  the  five  years  during  the  devel¬ 
opment  of  the  F-16,  the  data  collection,  verification  and  correction  tasks 
were  a  substantial  undertaking.  Each  stage  represents  a  time  when  an  incre¬ 
ment  of  data  has  been  developed  that  increases  knowledge  about  component 
characteristics . 

The  component  characteristics  used  in  this  study  are  the  following:  part 
number  (PN);  work  unit  code  (WUC);  maintenance  factor  (MF)  ;  unit  price; 
source,  maintenance,  and  recoverability  (SMR)  code;  base  condemnation  rate 
(BCR) ;  depot  condemnation  rate  (DCR) ;  quantity  per  aircraft  (QPA) ;  procurement 
leadtime  (PCI);  order  and  ship  time  (OST);  depot  repair  time  (CRT);  base 
repair  time  (BRT);  and  the  not-repairable-this-station  (NRTS)  rate.  Details 
of  these  characteristics  are  presented  in  Table  2-1. 

Stage  1 

A  detailed  comparison  of  F-16  and  F-111F  equipment  was  made  at  the 
subsystem  level  to  develop  system  complexity  factors.  The  F-111F  was  used 
because  there  is  a  high  percentage  of  common  equipment  between  the  two  air¬ 
craft.  The  comparison  was  made  for  a  time  period  when  the  F-111F  utilization 
rate  was  approximately  the  same  as  the  expected  F-16  utilization  rate  of  30 
flying  hours  per  aircraft  per  month. 
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NAME 

Parc  Number  (PN) 


Work  Unit  Code  (WUC) 


Maintenance  Factor  (MF) 


Unit  Price 


Source,  Maintenance 
and  Recoverability 
(SMR) 


3ase  Condemnation 
Rate  (BCR) 


Depot  Condemnation 
Rate  (DCR) 


Mo  t-Repairable-This- 
Station  (NRTS)  Rate 


Quantity  Per  End  Item 

(QP5I) 

Procurement  Lead 
Time  (PCL) 


Order  and  Ship 
Time  (OST) 


Depot  Repair  Time 
(DRT) 


Base  Repair  Time  (3RT) 


TABLE  2-1.  COMPONENT  CHARACTERISTICS 


DEFINITION 

The  contractor's  identi¬ 
fication  of  a  component 

Code  used  to  identify 
the  system,  subsystem 
and  reparable  component 

Number  of  failures  per 
100  flying  hours; 
equivalent  to  removal 
rate. 

Price  for  one  component 
or  set  of  components 


Codes  defining  the  source 
of  acquisition  and  main¬ 
tenance  concept  of  a  com¬ 
ponent,  i.e.,  whether  and 
where  it  will  be  repaired. 

Percent  of  removed  compo¬ 
nents  condemned  at  base 
level 

Percent  of  NRTS  compo¬ 
nents  condemned  at  the 
depo  t 

Percent  of  removed  compo¬ 
nents  chat  cannot  be 
repaired  at  the  base  and 
are  shipped  to  the  depot 
for  repair 

Number  of  components 
per  end-item  (aircraft) 

The  sum  of  the  time 
to  receive  the  component 
from  the  manufacturer 
once  it  is  ordered  plus 
three  months  of  adminis¬ 
trative  time 

Days  to  transfer  compo¬ 
nent  from  depot  to  base 
or  vice  versa 

Days  to  repair  compo¬ 
nent  at  depot 


Days  to  repair  compo¬ 
nent  at  base 


TIME  WHEN  KNOWN 

Generally  before  Full 
Scale  Development  (FSD) 


Generally  before  FSD 


Estimated  before  FSD, 
deemed  to  be  mature 
after  two  years. 

Estimated  before  FSD, 
usually  negotiated 
before  delivery. 

Assigned  before  FSD 


Estimated  before  FSD, 
calculated  in  D041 
System 

Estimated  before  FSD, 
calculated  in  D041 
System 

Estimated  before  FSD, 
calculated  in  D041 
System 


Before  FSD 


Estimated  before  FSD 


Estimated  before  FSD 


Estimated  before  FSD, 
calculated  in  D041 


Estimated  before  FSD, 
calculated  In  D041 


REMARKS 

May  be  changed  due  to 
modifications  and 
design  changes. 


Is  always  changing, 
but  tends  to  stabilize 
when  estimated  by  a 
two-year  moving  average 

May  change  due  to 
related  or  unrelated 
modifications  to  its 
contract. 


Changes  due  to  modi¬ 
fications  and  avail¬ 
ability  of  raw  material 


Initially  the  same 
constant  for  all  com¬ 
ponents  . 

Initially  the  same 
constant  for  all  com¬ 
ponents  .  Also  called 
Depot  Repair  Cycle  Time 

Initially  the  same 
constant  for  all  com¬ 
ponents.  Also  called 
Base  Repair  Cycle  Time. 
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These  comparisons  are  documented  in  Volumes  1  and  2  of  a  General 
Dynamics  report  called  the  AAA  Report  [9] .  The  AAA  Report  contains  no 
component-level  data;  it  simply  documents  the  techniques  and  methodologies 
used  to  evaluate  the  reliability,  capability,  status,  and  problem  areas  of  the 
F-16  during  the  definition,  design,  development,  and  evaluation  phases.  Mean 
flying  time  between  failures  (MFTBF)  values  at  this  stage  were  based  on 
historical  data  from  a  number  of  aircraft.  Historical  component  character¬ 
istics  were  modified  to  estimate  F-16  MFTBF  based  on  the  complexity  of  the 
F-16  (relative  to  the  aircraft  from  which  historical  data  were  drawn),  ad¬ 
vances  in  technology,  the  state-of-the-art  of  certain  equipment  in  some  F-16 
systems,  and  the  reliability  growth  on  similiar  subsystems  and  equipments.  At 
this  stage,  data  reflect  a  combination  of  historical  data,  engineering  esti¬ 
mates,  and  the  results  of  flight  tests  between  April  and  August  1974  (the  date 
of  the  first  draft  of  the  AAA  Report). 

Stage  2 

During  1975,  1976,  and  1977  component-level  data  were  analyzed  and 
published  as  books  of  Optimum  Repair  Level  Analysis  (ORLA)/Depth  of  Repair 
Record  (DORR)  information.  The  purpose  of  an  ORLA  is  to  determine  the  optimal 
repair  level  of  a  component  based  on  the  life  cycle  cost.  The  DORR  provides  a 
summary  of  pertinent  information  about  the  component  such  as  the  part  number, 
MFTBF,  QPA,  WUC,  contractor  and  government  maintenance  factors,  NRTS  rate, 
condemnation  rate,  and  SMR  code.  These  ORLA/DORR  data  (often  shortened  to 
ORLA  data  in  this  report)  were  used  to  analyze  spares  requirements  and  de¬ 
termine  the  number  and  selection  of  spares  for  the  first  three  spares  con¬ 
tracts.  They  were  also  used  in  this  study  to  examine  alternative  spares 
acquisition  strategies. 
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The  ORLA/DORR  process  is  quite  complex  but  is  described  here  because 
it  shows  the  thoughtfulness  and  thoroughness  used  in  the  F-16  program  in 
developing  early  estimates  of  component  characteristics.  Within  General 
Dynamics  (GD)  an  Engineering/Maintainability  group  identified  recoverable  com¬ 
ponents  and  collected  cost,  MFTBF,  technical  publication  requirements,  train¬ 
ing  requirements,  and  support  equipment  requirements  for  each  component.  The 
MFTBF  was  converted  to  a  mean  time  between  corrective  tasks  (MTBCT)  by  the 
following  formula: 

MTBCT  =  MFTBF  t  K  where 


v  _  MTB  Failures  Equipment  Non-Spares 

MTB  Maintenance  . ^X1  ^  x  Adjustment 

Adjustment  J 

The  first  factor  of  the  K  calculation  is  derived  from  maintenance  data  col¬ 
lected  on  other  aircraft.  The  second  factor  is  based  on  engineering  judgments 
by  the  manufacturer  relating  to  the  equipment  design  and  location.  This 
factor  is  a  judgment  by  the  manufacturer  based  on  maintenance  experience  on 
similar  equipment.  The  last  factor  is  also  a  manufacturer’s  judgment  on  the 
adjustments  and  repairs  on  the  component  that  will  not  require  a  spare  item. 
Therefore,  MTBCT  represents  the  expected  mean  time  between  demands  for  a 
mature  system. 

All  these  data  were  entered  into  a  computer  program  developed  by  GD 
to  estimate  the  0R1A  life  cycle  costs  and  generate  the  data  for  the  ORLA/DORR 
books.  The  data  were  reviewed  by  a  team  of  GD  personnel  consisting  of  rep¬ 
resentatives  from  Manufacturing,  Technical  Publications,  the  F-16  Program 
Office,  Logistics  Support,  Division  Estimation,  Engineering/  Support  Systems, 
and  Engineering/Maintainability.  Once  this  team  reviewed  the  ORLA/DORR  in¬ 
formation,  it  was  submitted  to  the  Air  Force  Resident  Integrated  Logistics 
Support  Activity  (RILSA)  for  review.  At  this  stage,  RILSA  personnel  reviewed 
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the  contractor’s  numbers  to  determine  whether  their  operational  (historical) 
experience  agreed  with  the  contractor’s  estimates  of  component 
characteristics . 

The  team  from  GD  and  the  RILSA  sequentially  reviewed  the  ORLA/DORR 
books  once  again  and  the  final,  approved  ORLA/DORR  report  was  submitted  to  the 
government.  During  the  second  RILSA  review,  component  maintenance  factors 
were  ’’derated.”  The  RILSA  ’’derated”  the  estimated  maintenance  factors  to 
calculate  a  value  for  use  in  supporting  initial  provisioning  requirements 
because  the  estimated  factors  were  based  on  data  from  mature  systems .  The 
derate  factors  were  developed  for  specific  equipment  using  the  concepts  of  Mr. 
J.  T.  Duane.  His  theory,  verified  by  test  at  the  General  Motors  Corporation, 
states  that  new  equipment  reliability  will  increase  during  the  early  develop¬ 
ment  stages  as  y  =  bxa  (where  in  this  case  y  =  MTBCT ,  b  =  the  initial  value  of 
MTBCT,  a  =  the  reliability  growth  rate  and  x  =  cumulative  flying  hours). 
Since  the  derated  maintenance  factors  were  not  yet  available  in  January  1977 
(the  date  we  assumed  for  initial  provisioning  in  our  analysis),  we  used  the 
factors  without  derating  in  our  calculations.  The  derated  maintenance  factors 
would  have  been  even  more  pessimistic. 

Stage  3 

The  next  increment  of  data  was  collected  between  April  and  December 
1978  at  the  Full  Scale  Development  (FSD)  Air  Vehicle  Reliability  Demonstra¬ 
tion.  The  tests  performed  during  this  period  conformed  to  the  appropriate 
military  standards.  The  tests  were  designed  to  determine  whether  subsystems 
met  the  FSD  MFTBF  goals  promised  in  the  contract  and  the  AAA  Report.  Reli¬ 
ability  was  thus  demonstrated  at  the  subsystem  rather  than  the  component 
level . 
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Stage  4 


The  Integrated  Logistics  Data  File  (ILDF)  system  documents  changes 
to  component  characteristics  since  the  first  aircraft  was  delivered  to  Hill 
Air  Force  Base  in  January  1979.  The  ILDF  contains  historical  records  of  all 
F-16  components.  The  records  include  links  that  show  the  item  that  replaced  a 
given  component  or  was  replaced  by  that  component.  The  most  recent  component 
characteristics  for  a  given  part  number  are  stored  in  the  file.  The  file  is 
updated,  as  often  as  weekly,  based  on  information  provided  by  GD.  The  ILDF 
would  be  an  excellent  source  of  data.  It  tracks  changes  in  component  char¬ 
acteristics  such  as  cost,  maintenance  factor,  NETS  rate,  condemnation  rate, 
and  design  changes.  It  is  a  single  source  of  data  that  could  provide  vital 
information  on  the  steps  taken  during  the  F-16  program.  Unfortunately,  much 
of  the  data  about  a  component  are  missing  and  there  is  no  way  to  associate  a 
date  with  the  data.  The  date  does  not  indicate  the  date  of  the  last  change  to 
a  field;  that  is,  pertinent  fields  do  not  have  a  change  date  attached  to  the 
field.  Maintaining  a  complete  ILDF  is  a  very  large  task  of  verification  and 
correction  as  well  as  of  computer  storage  and  cost.  Despite  this  omission,  we 
found  ILDF  data  useful  in  determining  the  procurement  leadtime  for  components 
and  in  tracing  part  number  changes  so  that  the  data  used  in  our  analysis  was 
consistent  over  different  time  periods. 

Stage  5 

Air  Force  data  systems  track  maintenance  actions  on  all  active 
aircraft.  Maintenance  data  are  available  from  each  installation,  from  the 
AFLC  D056  system,  and  also  from  a  contractor,  Dynamics  Research  Corporation 
(DRC),  in  a  consolidated  form.  Normally  maintenance  data  are  also  available 
in  the  D04l  system,  but  for  the  F-16  our  most  recent  D04l  tapes  (as  of 
September  1979)  had  very  little  data.  The  DRC  data  were  readily  available,  so 
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DRCfs  data  were  used  in  this  analysis.  Besides  the  ILDF  data,  a  GD  document 
called  "Work  Unit  Code/Work  Breakdown  Structure  Cross  Reference  Listing  for 
the  F-16  Line  Replaceable  Units"  [10]  provided  cross-reference  information  so 
that,  except  for  a  few  components  that  were  recently  added  to  or  deleted 
entirely  from  the  aircraft,  a  comparison  of  0RLA/D0RR  data  and  maintenance 
data  can  be  made.  The  data  extracted  from  DRC’s  F-16  Centralized  Data  System 
(CDS)  include  the  number  of  maintenance  actions  by  action- taken  code,  by 
month,  by  component  (WUC),  for  all  failure  types.  The  flying  hour  program  for 
each  month  was  also  extracted. 

We  now  discuss  the  results  of  our  analysis  of  F-16  component- 
characteristics  data  with  respect  to  initial  estimates  of  maintenance  factors 
and  unit  costs  and  their  observed  values. 

COST  ANALYSIS  OF  SELECTED  ITEMS 

We  conducted  a  limited  analysis  of  F-16  cost  data  because  (1)  prices  paid 
were  not  readily  available  and  (2)  some  prices  are  still  not  yet  definite.  We 
selected  20  SAIP  items  that  are  either  expensive  or  high-demand  items.  We 
further  converted  all  prices  to  1976  constant  dollars  using  Air  Force  infla¬ 
tion  indices  for  replenishment  spares.  The  selected  items  were  paid  for 
during  1977  to  1980  and  the  following  indices  were  used:  1976-1977,  3.27 
percent  inflation  rate;  1976-1978,  12.33  percent  inflation  rate;  1976-1979, 
19.75  percent  inflation  rate;  and  1976-1980,  26.5  percent  inflation  rate. 
Table  2-2  lists  the  SAIP  items  we  analyzed  based  on  USAF  SAIP  options  I,  II, 
and  III.  Comparing  the  1976  (ORLA)  price  estimates  to  the  average  of  the 
actual  price  paid  (in  1976  dollars) ,  nine  of  the  20  items  had  a  price  in¬ 
crease,  the  remaining  11  items  had  a  price  decrease.  The  net  change  in  total 
cost  (in  1976  dollars)  for  the  items  purchased  is  a  nine  percent  decrease. 
The  net  change  in  total  cost  in  current  dollars  is  a  16.8  percent  increase. 


2-8 


TABLE  2-2.  PRICE  DATA  FOR  SELECTED  SAIP  (I,  II,  III)  ITEMS 


Prices  in  1976  Dollars 


Nomenclature 

Total 

Quantity 

Ordered 

ORLA  Unit 

Price 

Estimate 

SAIP  II 

Unit  Price 
Estimate 

Average 

Unit  Price 
Paid 

Price** 

Paid 

Range 

Nose  Radome  Cover 

20 

$  14,232 

$  27,807 

$  10,714 

$  12,883  - 

15,377 

Canopy  Assy.  (F-16A) 

9 

24,711 

50,082 

40,164 

54,641  - 

54,655 

Canopy  Assy.  (F-16B) 

16 

39,277 

85,677 

40,735 

46,386  - 

56,574 

Aft  Fixed  Transparency 

46 

3,142 

2,801 

1,748 

1,702  - 

2,267 

Main  Landing  Gear  Wheel  Assy. 

582 

532 

2,507 

1,581 

1,679  - 

1,953 

Flight  Control  Computer 

80 

29,281 

45,457 

40,166 

41,184  - 

56,804 

Integrated  Rudder  Servo  Actuator 

27 

21,545 

27,977 

19,418 

19,321  - 

24,753 

Horizontal  Stabilizer 

14 

20, 173 

40,595 

16,601 

16,548  - 

22,980 

Bleed  Air  Power  Unit 

15 

16,500 

30,663 

20,910 

22,739  - 

29,222 

Jet  Fuel  Starter  Assy. 

59 

23,000 

1,991* 

18,283 

19,795  - 

25,788 

Accessory  Drive  Gearbox 

27 

12,700 

67,347 

30,182 

17,304  - 

54,465 

Hydraulic  Reservoir 

90 

1,270 

1,849 

1,532 

1,567  - 

2,051 

Attitude  Director  Indicator 

174 

4,061 

5,175 

2,429 

2,668  - 

3,208 

Central  Air  Data  Computer 

36 

25,625 

27,858 

15,676 

14,174  - 

20,882 

Digital  Signal  Processor 

40 

60,645 

119,498 

64,959 

73,724  - 

107,646 

Heads-Up  Display  Unit 

96 

41,012 

40,448 

27,369 

28,463  - 

41,565 

Heads-Up  Display  Electronics  Unit 

45 

41,398 

47,822 

31,158 

32,949  - 

52,926 

Inertial  Navigation  Unit 

77 

156,051 

169,674 

125,548 

147,432  - 

193,166 

Hydraulic  Drive 

18 

18,875 

6,203 

4,991 

5,204  - 

5,833 

Radar/Electro-Optical  Display  Unit  216 

10,739 

10,843 

12,667 

8,192  - 

26,592 

Total  Number  of  Units  Ordered 

1,687 

Total  Price  Using  ORLA  Estimates 

$31,388,221 

Total  Price  Paid 

$28,651,169 

Total  Price  Using  SAIP  II  Estimates 

$39,725,232 

*  This  appears  to  be  a  mistake  in  the  MOD-METRIC  price  input 

**  In  then  current  dollars 


MAINTENANCE  FACTORS 


The  maintenance  factors  observed  are  0.257  times  the  estimated  (ORLA) 
maintenance  factors  on  average.  Table  2-3  shows  the  estimated  and  actual 
observed  maintenance  factors  for  different  time  periods  for  various  subsystems 
of  the  aircraft.  Before  one  examines  the  table  in  detail,  it  is  important  to 
understand  the  method  used  to  calculate  maintenance  factors. 

Maintenance  factors  were,  as  mentioned  previously,  derived  from  DRC’s  CDS 
file  of  all  maintenance  actions  from  1  January  1979  to  30  June  1981.  We  used 
only  those  records  with  action-taken  codes  A,  B,  D,  E,  F,  G,  H,  J,  K,  L,  P,  Q, 
R,  S,  T,  U,  V,  W,  Y,  Z,  and  1-9.  We  used  the  shop  repair  action-taken  codes 
rather  than  action-taken  code  C,  because  it  appeared  that  using  action- taken 
code  C  would  seriously  undercount  the  number  of  maintenance  actions  taken.  In 
other  words,  data  inconsistencies  led  us  to  believe  that  using  code  C  would  be 
misleading.  Codes  M,  N,  and  X  were  excluded  because  they  do  not  represent 
component  repairs.  Appendix  C  contains  the  definitions  for  each  of  the 
action-taken  codes  and  shows  the  overlap  or  redundancy  resulting  from  using 
all  codes . 

Furthermore,  our  analysis  omitted  the  main  landing  gear  tire  and  the 
wheel  assembly  because  there  were  no  maintenance  actions  recorded  for  these 
two  items  for  the  first  nine  months.  The  analysis  also  omitted  the  batteries. 
The  next  section  will  explore  missing  and  misleading  data  in  more  detail. 

Even  after  maintenance  factors  were  computed  correctly,  i.e.,  without 
double  counting  or  obvious  data  inconsistencies,  the  result  remained:  ORLA 
estimates  are  four  times  as  great  as  those  calculated  using  actual  maintenance 
records.  After  checking  another  source  (the  D056  data  system)  to  insure  that 
the  CDS  data  captured  all  maintenance  records,  we  examined  component  data.  We 
found  several  items  for  which  the  ORLA  estimate  appeared  to  be  illogically 
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TABLE  2-3.  SUBSYSTEM  LEVEL  AVERAGE  MAINTENANCE  FACTORS 


wuc 

ORLA 

1  Month  3  Months  6  Months 

12  Months 

30  Months 

11000 

.0130 

.0000 

.0000 

.0012 

.0015 

.0008 

12000 

.1896 

.0000 

.0000 

.0000 

.0013 

.0015 

13000 

.0532 

.0000 

.0190 

.0241 

.0219 

.0179 

14000 

.0973 

.0000 

.0406 

.0233 

.0327 

.0265 

23000 

.0786 

.0000 

.0708 

.0764 

.0384 

.0273 

24000 

.0765 

.0000 

.0291 

.0400 

.0339 

.0238 

41000 

.0634 

.0000 

.0151 

.0154 

.0116 

.0151 

42000 

.  1152 

.0000 

.0695 

.0354 

.0232 

.0195 

44000 

.1872 

.0000 

.0000 

.0189 

.0209 

.0196 

45000 

.0608 

.0000 

.0000 

.0000 

.0088 

.0118 

46000 

.0624 

.0555 

.0414 

.0197 

.0251 

.0177 

51000 

.0740 

.0000 

.0000 

.0097 

.0151 

.0197 

55000 

.0120 

.0000 

.0000 

.0000 

.0000 

.0037 

64000* 

.0877 

.0000 

.0000 

.0346 

.0226 

.0160 

74000** 

.1414 

.1613 

.0928 

.0893 

.0663 

.0483 

75000 

.0695 

.0000 

.0693 

.0551 

.0486 

.0267 

76000 

.0897 

.0000 

.0679 

.0259 

.0245 

.0082 

TOTAL  SYSTEM 
AVERAGE 

.0852 

.0345 

.0378 

.0336 

.0287 

.0212 

^Combined  with 
**Combined  with 

WUCs 

WUCs 

for 

for 

62000 

71000 

and  63000 
Subsystem 

Subsystems 
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high.  For  instance,  the  landing  light  assembly  had  an  estimated  ORLA  mainte¬ 
nance  factor  of  0.334  per  hundred  flying  hours.  This  is  91  times  the  observed 
maintenance  factor  to  date  of  0.00366.  This  assembly  consists  of  a  sealed 
beam  lamp  and  transformer  in  an  aluminum  case  bolted  to  the  left  main  landing 
gear  strut.  Although  the  entire  assembly  may  be  removed,  repair  is  usually 
accomplished  by  replacing  the  sealed  beam  lamp  or  other  consumable  piece 
parts.  Similarly,  covers  and  doors,  which  are  frequently  removed  to  repair 
items  behind  them  but  seldom  need  to  be  replaced,  had  ORLA  maintenance  factors 
that  were,  on  the  average,  13  times  higher  than  the  observed  factors. 

One  other  possible  source  of  error  in  determining  requirements  relates  to 
the  pipeline  constants  used  in  1976-77.  In  our  analysis  we  used  the  order- 
and-ship,  base  repair,  and  depot  repair  times  specified  in  the  programming 
checklist  and  in  specific  instructions  for  computing  initial  spares  require¬ 
ments  for  the  F-16.  We  did  not  compare  these  estimates  to  the  times  observed 
for  base  repair,  depot  repair,  etc.  However,  since  the  depot  and  the  first 
base  to  received  F-I6s  are  collocated  (Hill  AFB) ,  data  for  essentially  the 
first  year  reflect  aircraft  at  one  location. 

MISSING/MISLEADING  OPERATIONAL  DATA 

We  excluded  the  main  landing  gear  tire  and  the  wheel  assembly  as  well  as 
the  aircraft  batteries  from  most  of  our  analysis  of  F-16  spares  requirements. 
They  were  excluded  for  differing  reasons.  The  main  landing  gear  tire  and  the 
tire-and-wheel  assembly  had  no  maintenance  actions  recorded  in  the  first  nine 
months  of  aircraft  operations.  We  confirmed  that  this  glaring  omission  was 
also  discovered  by  the  Air  Force  and  was  subsequently  (by  the  tenth  month  of 
operation)  corrected.  Since  much  of  our  analysis  focuses  on  the  use  of  early 
operational  data,  we  eliminated  the  main  landing  gear  tire  and  the  tire-and- 
wheel  assembly  from  our  analysis. 
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The  batteries  suffered  from  a  different  problem.  The  operational  data 
showed  that  the  flight  control  batteries  (four  per  aircraft)  spent  an  in¬ 
ordinate  amount  of  time  (typically  in  eight  hour  intervals)  in  maintenance. 
When  questioned  about  this,  the  Air  Force  confirmed  that  they  had  had  problems 
with  the  batteries.  The  flight  control  batteries  are  turned  on  by  a  switch 
that  closes  when  the  nose  landing  gear  strut  extends.  It  was  intended  that 
the  switch  be  closed  only  when  the  aircraft  is  in  flight.  In  fact,  however, 
it  closed  whenever  the  aircraft  was  jacked  up  and  opened  and  closed  repeatedly 
during  taxi,  takeoffs,  and  landings.  As  a  result,  the  batteries  went  dead 
often  and  did  not  seem  to  hold  their  charge.  The  problem  was  finally  diag¬ 
nosed  and  corrected.  In  addition,  problems  with  the  main  aircraft  battery  and 
its  ability  to  hold  a  charge  existed.  The  batteries  were  therefore  removed 
from  our  analysis. 

Some  components  with  missing  data  were  not  excluded  from  our  analysis. 
Reliability  improvement  warranty  (RIW)  items,  usually  line  replaceable  units 
(LRU) ,  are  items  that  were  identified  early  as  potential  problems  to  overall 
aircraft  reliability.  These  items  were  placed  under  a  special  contractual 
incentive  to  improve  their  reliability.  For  the  first  18  to  24  months  of  F-16 
operation  the  LRU  failures  were  reported  by  Air  Force  maintenance  personnel 
and  are  in  the  data.  -'However,  the  contractor  repaired  the  shop  replaceable 
units  (SRUs)  within  the  LRU.  There  was  a  delay  in  the  contractor’s  reports  of 
which  SRUs  failed  so  that  some  of  these  failures  were  not  reported  before 
January  1981. 

Finding  these  two  problems  --  one  of  missing  data  and  one  of  misleading 
data  --  prompted  us  to  analyze  the  operational  data  further.  In  particular, 
we  compared  the  maintenance  factors  from  the  first  half  of  the  flying  hour 
program  (27,867  hours  flown  during  the  first  23  months)  and  the  second  half  of 
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the  flying  hour  program  (26,711  hours  flown  during  the  last  seven  months). 
The  plot  in  Figure  2-1  shows  the  two  sets  of  maintenance  factors.  Their  means 
are  0.0220  and  0.0202  (within  nine  percent  of  each  other)  and  their  correla¬ 
tion  coefficient  is  0.947.  Therefore,  we  conclude  that  the  omission  of 
records  observed  for  the  tires  did  not  exist  in  general. 

Dealing  with  misleading  data  is  more  difficult.  In  a  practical  sense, 
problems  with  a  particular  component  due  to  a  design  deficiency  will  manifest 
themselves.  This  is  especially  true  for  an  item  that  is  "flying"  more  hours 
than  it  was  designed  to  fly,  for  example  the  batteries  that  were  erroneously 
using  power  when  the  aircraft  was  jacked  up. 

Other  early  data  are  misleading  because  of  the  non-stationarity  of  the 
failure  rates  of  components  (for  example,  batteries  seldom  fail  when  they  are 
new,  but  they  certainly  do  fail) .  The  provisioner  must  not  mistake  the  lack 
of  early  failures  (on  items  such  as  a  battery)  for  a  zero  failure  rate.  We 
found  many  items,  especially  on  the  airframe,  with  no  maintenance  actions. 
Failures  of  these  items  are  likely  to  be  random  and  infrequent.  The  fact  that 
they  are  not  replaced  during  a  certain  time  period  is  useful  in  predicting 
their  actual  mean  times  between  failures  and  thus  their  maintenance  factors. 
The  use  of  early  operational  data  is  discussed  in  Chapter  4. 
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SECOND  HALF.  CDS  DATA 


FIGURE  2*1  OBSERVED  MAINTENANCE  FACTORS 


FIRST  HALF,  CDS  DATA 


0.45 


3.  THE  USE  OF  AVAILABILITY  MODELS  IN  INITIAL  PROVISIONING 


INTRODUCTION 

An  availability  model  is  a  mathematical  model  that  determines  the  rela¬ 
tive  worth-versus-cost  of  a  wide  range  of  possible  quantities  of  spares  of 
each  of  a  system's  components  and  finds  the  optimal  mix  of  spares  for  any 
specified  level  of  weapon-system  availability.  Thus,  availability  models  take 
a  system  view  in  that  they  look  across  all  of  the  components  in  a  system  and 
take  explicit  account  of  both  cost  and  readiness  in  computing  the  best  spares 
mix.  In  this  chapter,  we  examine  in  detail  two  different  approaches  to  the 
computation  of  requirements  in  initial  provisioning.  One  approach  involves 
the  use  of  availability  models.  The  other  approach  is  an  item-oriented 
approach  as  prescribed  by  DoDI  4140.42.  The  remainder  of  this  chapter  will 
demonstrate,  for  the  F-16,  the  superiority  of  stockage  postures  computed  by 
using  an  availability  model. 

In  this  chapter,  we  first  discuss  the  item-oriented  approach  established 
by  DoDI  4140.42  and  calculate  the  predicted  availability  of  the  F-16  (based  on 
F-16-peculiar  recoverable  items)  using  three  interpretations  of  the  Air  Force 
regulation  that  implements  DoDI  4140.42.  We  then  explain  our  calculation  of 
"actual"  availability,  the  measure  we  use  to  compare  methods.  Finally,  we 
compare  the  best  of  the  item-oriented  methods  to  an  availability  model.  From 
this  comparison  we  draw  some  conclusions  about  the  usefulness  of  availability 
models  in  computing  spares  requirements  and  in  determining  the  level  of 
investment  for  spare  components. 

STOCKAGE  POSTURES  USING  AFLCR  57-27 

DoDI  4140.42  (August  1974)  establishes  DoD  policy  relative  to  stockage 
criteria  and  the  determination  of  requirements  for  secondary  item  spare  and 
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repair  parts.  Air  Force  Logistics  Command  Regulation  (AFICR)  57-27  provides 
policy  and  procedures  for  determining  initial  requirements  for  Air  Force 
expense,  investment,  and  equipment  items.  The  policy  prescribed  in  DoDI 
4140.42  relating  to  initial  spares/repair  part  requirements,  is  implemented  by 
AFLCR  57-27.  The  earliest  computation  of  spares  requirements  for  the  F-16 
aircraft  was  based  on  AFLCR  57-27  which  provides  for  the  use  of  models  as  well 
as  its  set  of  computational  rules.  We  have  designated  the  computational  rules 
M57-27tf  and  called  any  model  approved  for  use  under  AFLCR  57-27  by  the  model’s 
name.  The  computation  of  the  first  spares  requirements,  SAIP  I,  followed  the 
57-27  instructions  for  recoverable  items.  Exceptions  to  the  57-27  instruc¬ 
tions,  as  well  as  specific  worksheets,  were  published  in  Reference  [11]  for 
F-16  initial  spares.  One  notable  exception  to  57-27  instructions  is  that  the 
procurement  of  the  depot  stock  level  requirement  was  deferred  for  USAF-managed 
items.  Figure  3-1  shows  the  ground  rules  for  the  initial  provisioning  compu¬ 
tations  for  the  F-16.  Figure  3-2  shows  the  F-16  computation  worksheet.  These 
computations  omit  the  following  AFLCR  57-27  factors  because  the  procurement  of 
a  30-day  depot  stock  level  was  deferred: 

-  Procurement  Cycle/Safety  Level  for  depot  level  maintenance  (DLM) 

program 

Leadtime  DLM  program 

In  addition,  Depot  Repair  Cycle  Requirements,  Floating  Stock  Level  Require¬ 
ments,  War  Readiness  Materiel,  and  the  57-27  ’’Other”  category  are  not  ap¬ 
plicable  for  F-16  initial  requirements  computations. 

The  Air  Force  only  used  57-27  to  calculate  spares  requirements  for  the 
first  38  aircraft  for  the  first  year.  A  MOD-METRIC  program  was  used  to  de¬ 
termine  subsequent  spares  requirements.  However,  we  calculated  the  spares 
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FIGURE  3-1.  GROUND  RULES  FOR  USAF  F-16  SPARES 
COMPUTATIONS  FOR  RECOVERABLE  ITEMS* 


Excerpt  I 

1.  Factors  and  programming  will  normally  be  based  on  maintenance  period 
of  100  hours. 

2.  Quantity  per  component  will  be  the  quantity  per  each  next  higher 
recoverable  assembly. 

3.  All  computations  will  be  rounded  to  the  next  unit  pack. 

4.  Quantities  will  be  rounded  up  at  0.5;  0.5  or  greater  will  be  increased 
to  next  whole  number. 

5.  All  segments  will  be  rounded  to  one  decimal  place. 

8.  Factors  and  rates  will  be  rounded  to  four  decimal  positions. 

10.  All  condemnation  on  recoverable  split  repair  will  be  considered  at 


depot  level. 

Excerpt  II 

ERRC**  "C" 

ERRC  "T" 

ERRC  "L 

Depot  Repair  Cycle: 

Organic 

52  days 

55  days 

52  days 

Base  Stock  Level: 

Base  0ST 

5  days 

12  days 

12  days 

BRC 

2  days 

5  days 

2  days 

Overhaul  Stock  Level 

12  days 

12  days 

12  days 

Depot  Stock  Level 

30  days 

30  days 

30  days 

(See  Note  3) 

Note  3:  The  depot  stock  level  requirement  will  be  deferred 
from  procurement  for  USAF  items . 

*Excerpted  from  Reference  [ll] 

**Part  of  the  source,  maintenance,  and  recoverability  (SMR)  code. 
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USAF/EPG 

COMPUTATION  PROCEDURE  FOR 
RECOVERABLE  CONSUMPTION  ITEMS 


NRTS 


T,  C,  L  6TH  POSITION  SMR  CODE 
(EXCLUDE  IF  D  IN  POSITION  3) 
RATES 

^  ^  -  “  D 


BCP 


NRTS 


X  (l.O'O  - _ ) 


MF  D^R 


X 


V. 


MF  DDR 


BRR  J 


MF 


[ (DCR  X  NRTS)  + 

(1.00  -  NRTS)  X  BCP  ] 


WOR 


X 


FORMULA 


1. 


LT  SL 


AMP  QPEI  WOR  NOA 


X 


Operating  Qtv 


AMP  QPEI  MF  X  NRTS  DRC  NOA 


2. 


DRC  QTY 


30 


3. 


12  DO&ST  DDR  10  DBRC  BRR  BRC 


X 


)  +  ( 


X 


10 


QPEI  NOA 


X  X 


BS 


AM?  QPEI  DDR  NOA 


4. 


X 


DSL  QTY 


SUM  of  1.  OP,  2.  DRC,  3.  BSL,  and  4.  DSL  =  TOTAL  REQUIREMENTS 


FIGURE  3-2.  F-16  REQUIREMENT  COMPUTATION  WORKSHEET 
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using  57-27  for  the  entire  two-year  initial  provisioning  period  for  illustra¬ 
tive  purposes .  Table  3-1  shows  the  results  of  our  analysis  of  57-27  spares 
requirements.  The  methodologies  and  evaluation  techniques  will  be  discussed 
below.  As  mentioned  previously,  none  of  the  calculations  here  duplicate  F-16 
spares  requirements  calculations  since  the  Air  Force  switched  to  the  use  of 
MOD-METRIC.  The  use  of  an  approved  model  is  authorized  by  both  AFLCR  57-27 
and  DoDI  4140.42. 

TABLE  3-1.  AVAILABILITY  UNDER  DoDI  4140.42 


ITEM-ORIENTED 

APPROACH 

"Actual" 

Time 

Resulting 

Avail¬ 

Method 

Period 

Budget 

ability 

F-16 

2  Years 

$18 . 04M 

31  percent 

57-27 

2  Years 

11.06M 

19  percent 

57-27 (M) 

2  Years 

28.13M 

48  percent 

57-27  SPARES  REQUIREMENTS  EVALUATION 

We  followed  three  slightly  different  methodologies  to  calculate  spares 
requirements  using  AFLCR  57-27.  These  methodologies  duplicated  the  calcula¬ 
tions  (1)  specified  for  the  F-16,  (2)  specified  by  AFLCR  but  constrained  by 
F-16  ground  rules,  and  (3)  modified  to  provide  a  pipeline  of  spares.  The 
three  methodologies  reflect  three  different  interpretations  of  AFLCR  57-27. 
Though  the  actual  formulae  used  differ  very  little,  they  result  in  a  wide 
range  of  budgets  and  availabilities. 

For  all  three  calculations  we  used  the  flying  hour  program  specified  in 
Revision  2  of  the  Programming  Check  List  (PCL) ,  dated  December  1976.  The 
flying  hour  program  and  the  delivery  schedule  used  are  shown  in  Table  3-2. 
These  data  were  used  in  all  our  analyses,  except  that  actual  hours  flown  were 
used  to  calculate  observed  maintenance  factors. 
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TABLE  3-2.  FLYING  HOURS  AND  AIRCRAFT  DELIVERY  SCHEDULE* 


AIRCRAFT  TOTAL  SCHEDULED 

DELIVERY  SCHEDULE  AIRCRAFT  MONTHLY  SCHEDULED 

DATE  F-16A  F-16B  AT  END  OF  MONTH  FLYING  HOURS 


78  Sep 

2 

0 

2 

0 

Oct 

0 

1 

3 

32 

Nov 

0 

1 

4 

53 

Dec 

0 

0 

4 

74 

79  Jan** 

0 

1 

5 

74 

Feb 

1 

1 

7 

95 

Mar 

1 

1 

9 

132 

Apr 

1 

2 

12 

169 

May 

2 

2 

16 

246 

Jun 

3 

3 

22 

328 

Jul 

2 

2 

26 

426 

Aug 

3 

3 

32 

524 

Sep 

3 

3 

38 

635 

Oct 

4 

3 

45 

855 

Nov 

4 

3 

52 

1000 

Dec 

5 

3 

60 

1158 

80  Jan 

6 

2 

68 

1389 

Feb 

6 

2 

76 

1471 

Mar 

7 

2 

85 

1623 

Apr 

8 

2 

95 

1803 

May 

8 

2 

105 

2011 

Jun 

9 

2 

116 

2219 

Jul 

9 

2 

127 

2427 

Aug 

9 

2 

138 

2654 

Sep 

10 

2 

150 

2880 

As  of  December 

1976 

**  First  aircraft  actually  delivered 
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The  first  method,  labeled  F-16,  follows  the  worksheet  in  Figure  3-2.  The 
factor,  average  month  flying  hour  program  (AMP),  is  the  product  of  the  average 
month's  inventory  and  the  average  month's  utilization  rate  (average  flying 
hours  in  the  month).  The  flying  hour  programs  for  the  F-16A  and  F-16B 
differed  and  are  combined  in  the  analysis. 

The  second  method,  labeled  57-27,  follows  the  rules  set  forth  in  Figures 
3-1  and  3-2,  except  that  the  DRC  Quantity  was  changed  to  conform  to  the  def¬ 
inition  in  AFLCR  57-27.  Thus,  Item  2  in  Figure  3-2  was  changed  to  read  as 
follows : 

PMP  x  QPEI  x  MF  x  NRTS  x  (1-DCR)  x  DRC  x  NOA  =  DRC  QTY. 

Also,  the  peak  month  flying  hour  program  (PMP)  is  used  in  both  Items  1  and  2 
in  place  of  the  AMP  (to  conform  with  AFLCR  57-27).  The  PMP  is  similar  to  the 
AMP  but  is  defined  as  the  product  of  the  average  number  of  aircraft  at  the  end 
of  the  month  and  the  average  flying  hours  (F/H)  per  aircraft  over  two  years. 

The  third  method,  labeled  57-27 (M),  is  the  same  as  57-27  except  that  it 
uses  a  different  definition  of  PMP.  The  modified  PMP  is  defined  as  the 
product  of  the  number  of  aircraft  at  the  end  of  two  years  (i.e.,  150)  and  the 
average  F/H  per  aircraft  over  the  entire  two-year  time  period.  This  simulates 
continued  operation  of  the  aircraft  so  that  a  pipeline  of  spares  can  be 
calculated.  The  57-27 (M)  method  provides  for  a  pipeline  of  spares  for  the 
aircraft  at  the  end  of  the  two-year  initial  provisioning  period.  This  is 
consistent  with  the  Air  Force's  philosophy  of  end-item  support;  therefore,  the 
57-27 (M)  method  for  the  two-year  time  period  will  be  used  for  comparative 
purposes  with  the  availability  model  results  discussed  in  the  following 
section. 
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One  other  item  of  Table  3-1  must  be  defined,  the  data  labeled  "Actual" 
Availability.  Throughout  the  analysis  we  evaluated  stockage  postures  using  a 
specific  estimate  of  actual  failures.  We  now  discuss  this  measure  of 
performance . 

COMPUTATION  OF  "ACTUAL”  AVAILABILITY 

The  calculation  of  the  "actual"  availability  is  based  on  the  failures 
observed  and  reported  in  DRC's  CDS  data  file  described  in  Chapter  2.  As  men¬ 
tioned  previously,  after  four  components  were  removed  from  the  analysis,  the 
data  were  consistent  between  the  first  and  second  halves  of  the  flying  hours 
flown.  In  an  effort  to  use  as  much  data  as  possible  without  introducing 
possible  bias  by  using  all  30  months  of  the  data,  we  chose  the  last  24  months 
of  data  on  which  to  base  the  performance  evaluation.  Approximately  one  third 
of  the  components  had  no  failures  during  the  last  24  months  (also  during  the 
full  30  months),  but  based  on  the  53,615  hours  actually  flown  during  the 
period,  these  components  could  not  be  assigned  an  actual  failure  factor  of 
zero.  In  fact,  the  "actual"  availability  was  computed  using  maintenance 
factors  revised  in  a  Bayesian  sense.  The  method  of  Bayesian  revision  is  dis¬ 
cussed  in  detail  in  Chapter  4. 

We  used  the  VARI-METRIC  model  throughout  this  report  to  calculate  the 
availability  that  could  be  expected  to  be  delivered  by  a  stockage  posture. 
VARI-METRIC  calculates  an  "actual"  availability  by  computing  the  expected 
backorders  (EBO)  for  each  component,  given  its  asset  position  (number  of  each 
item  purchased)  and  the  revised  maintenance  factor.  In  this  application, 
VARI-METRIC  is  used  in  an  evaluative,  rather  than  optimizing,  mode.  Thus  the 
"actual"  availability  is  a  prediction  of  what  availability  would  have  been 
delivered  by  a  particular  stockage  posture  at  the  end  of  the  initial 
provisioning  period  based  upon  maintenance  factors  being  determined  by  a 
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Bayesian  weighting  of  the  initial  estimates  and  the  observed  failures  in  the 
last  24  months  of  the  CDS  data. 

To  summarize  the  findings  concerning  item-oriented  approaches  when  evalu¬ 
ated  against  the  "actual11  failures  as  described  above,  we  again  refer  to  Table 
3-1.  In  each  method,  the  "actual"  availability  was  less  than  50  percent;  that 
is,  had  any  of  these  methods  been  used  for  initial  provisioning,  the  stockage 
posture  computed  would  have  resulted  in  a  low  "actual"  availability  for  the 
F-16.  Had  the  ORLA  estimates  used  in  the  calculations  of  the  various  inter¬ 
pretations  of  the  AFLCR  57-27  methods  been  accurate,  rather  than  consistently 
overestimated,  the  "actual"  availabilities  would  have  been  even  lower.  The 
"actual"  availability  was  as  high  as  it  was  because  not  as  many  failures 
occurred  as  were  expected. 

STOCKAGE  POSTURES  USING  AN  AVAILABILITY  MODEL 

There  are  a  number  of  multi-echelon  inventory  models  that  could  be  used 
for  initial  provisioning.  In  initial  provisioning,  only  one  estimate  of  the 
maintenance  factor  exists,  and  there  are  no  operational  data  available  to 
calculate  a  mean  maintenance  factor.  Therefore,  a  model  that  takes  explicit 
account  of  the  uncertainty  about  the  estimated  maintenance  factors  is 
preferable  to  one  that  does  not.  The  VARI-METRIC  Model  developed  by  LMI  in 
1980  is  essentially  the  same  as  certain  other  models  except  for  its  explicit 
consideration  of  the  uncertainty  about  demand  rates.  VARI-METRIC  is  discussed 
in  more  detail  in  Appendix  A. 

For  a  given  budget  VARI-METRIC  generates  a  stockage  posture.  Associated 
with  this  stockage  posture  is  a  predicted  availability.  We  evaluated  this 
stockage  posture  using  a  probability  distribution  based  on  the  reported 
maintenance  actions  observed  in  the  24  months  from  1  July  1979  to  30  June 
1981,  as  described  previously. 
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Table  3-3  compares  VARI -METRIC  with  the  57-27 (M)  method.  The  table  shows 


the  superiority  of  VARI -METRIC  over  57-27 (M). 

TABLE  3-3.  COMPARISON  OF  VARI -METRIC  WITH  57-27 (M) 


Predicted 

"Actual1 

Budget 

Avail¬ 

Avail¬ 

Method 

Level 

ability 

ability 

VARI-METRIC 

$28 . 07M 

0.065 

0.58 

57-27 (M) 

$28 . 13M 

- 

0.48 

TECHNICAL  NOTE 

The  use  of  VARI -METRIC  requires  the  specif icatiou  of  the  parameter,  a.  a 
is  the  shape  parameter  of  the  probability  distribution  that  is  assigned  to  the 
maintenance  factor.  If  we  assign  Cf  =  1,  then  the  probability  distribution  is 
fairly  broad,  indicating  substantial  uncertainty.  The  larger  a,  the  more 
certainty  we  ascribe  to  our  prior  estimate  of  the  maintenance  factor.  The 
data  in  Table  3-4  show  how  the  performance  of  VARI-METRIC  changes  with  chang¬ 
ing  values  of  the  shape  parameter.  The  goal  is  to  find  a  value  of  a  such  that 
the  model  predicts  an  availability  that  is  consistent  with  the  actual, 
reported  maintenance  actions. 


TABLE  3-4.  THE  INFLUENCE  OF  THE  SHAPE  PARAMETER 
ON  VARI-METRIC  PERFORMANCE 


Predicted 

"Actual1 

Shape 

Budget 

Avail¬ 

Avail¬ 

Parameter 

Level 

ability 

ability 

a  =  1 

$28 . 07M 

0.065 

0.58 

a  =  1 

$30.00M 

0.078 

0.61 

a  =  2 

$30.00M 

0.186 

0.67 

a  =  10 

$30 . 00M 

0.464 

0.74 

a  =  2000 

$30 . 00M 

0.637 

0.76 

a  =  1  +  2  x  MF 

$30 . 00M 

0.139 

0.66 

a  =  1  +  10  x  MF 

$30 . 00M 

0.266 

0.72 
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We  caution  the  reader  not  to  conclude  from  these  data  that  a  large  value 
of  a  will  yield  the  best  stockage  posture  in  general.  That  is  not  the  case. 
The  reason  for  that  phenomenon  in  the  F-16  case  is  the  powerful,  systematic, 
positive  bias  in  the  maintenance  factors.  Without  the  bias,  a  value  of  a  =  1 
yields  a  stockage  posture  that  is  significantly  less  vulnerable  to  uncertainty 
than  one  computed  with  higher  values  of  a. 

SUMMARY 

Our  first  hypothesis  was  that  an  availability  model  computes  a  stockage 
posture  that  results  in  a  higher  availability  than  the  stockage  posture  pre¬ 
scribed  by  AFLCR  57-27  for  the  same  investment  level.  The  stockage  posture 
from  the  availability  model  is  superior;  however,  because  of  the  bias  in  the 
maintenance  factors,  the  model  did  not  predict  the  "actual'1  availability  well. 
Some  errors  are  worse  than  the  difference  in  average  maintenance  factors 
indicates.  Actual  maintenance  factors  are  up  to  100  times  smaller  than  ORLA 
estimated  maintenance  factors.  (Appendix  D  contains  a  list  of  every  component 
used  in  our  analyses  along  with  its  estimated  and  observed  maintenance 
factors.)  When  VARI -METRIC  takes  this  amount  of  uncertainty  into  account,  the 
cost  must  increase  to  meet  a  specified  level  of  availability.  Figure  3-3 
shows  availability-vs . -cost  curves  for  different  methods. 

The  item-oriented  approach  of  DoDI  4140.42  does  not  take  end-item  avail¬ 
ability  explicitly  into  account.  Thus,  predicted  availability  is  not  a  part 
of  the  spares  requirements  computation.  Availability  models,  naturally,  do 
predict  an  availability.  Had  an  availability  model  been  used  under  the  cir¬ 
cumstances  presented  in  our  discussion  so  far,  the  investment  level  would  have 
been  in  the  range  of  $70M  -  $100M,  depending  on  the  a  chosen,  rather  than  the 
$28M  of  the  57-27  (M)  method.  As  can  be  seen  in  Figure  3-3,  a  budget  level  of 
$100M  would  give  a  predicted  availability  of  about  85  percent,  the  F-16 
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FIGURE  3-3  PREDICTED  AVAILABILITY 

(ORLA  MF) 


availability  goal  after  two  years  [12].  The  dashed  line  in  Figure  3-3  shows 
the  "actual"  availability  of  the  spares  posture  when  Of  =  1. 

Figure  3-3  and  Table  3-3  may  give  the  erroneous  impression  that  a  large 
value  of  a  yields  the  best  stockage  posture.  That  this  is  true  for  the  F-16 
is  due  to  the  positive  bias  in  the  maintenance  factors.  It  is  not  true  in 
general.  In  fact,  we  are  convinced  that  setting  a  equal  to  1.0  yields  a 
stockage  posture  that  is  substantially  less  vulnerable  to  uncertainty  than 
stockage  postures  computed  with  larger  values  of  a. 

While  availability  models  provide  a  superior  stockage  posture,  these 
models,  like  all  other  methods  of  computing  initial  provisioning  requirements, 
must  have  some  reasonable  data,  in  particular  maintenance  factors,  on  which  to 
base  their  analysis.  The  next  chapter  discusses  the  use  of  early  operational 
data  in  improving  maintenance  factor  estimates. 

INVESTMENT  LEVELS  USING  AN  AVAILABILITY  MODEL 

The  first  spares  budgeting  and  initial  provisioning  planning  for  the  F-16 
was  done  in  July  1975.  At  that  time  the  initial  provisioning  budget  (BP-16) 
was  estimated  at  16  percent  of  the  aircraft  flyaway  cost. 

The  initial  ORLA  estimates  were  not  developed  until  a  year  later;  there¬ 
fore,  an  availability  model  such  as  METRIC,  VARI -METRIC,  MOD-METRIC,  or  SESAME 
that  depends  on  component-level  data  for  its  computations  could  not  have  been 
applied  to  the  earliest  determination  of  an  initial  spares  investment  level  in 
the  F-16  case.  The  question  remains,  however,  whether  such  a  model  would  be 
useful  later  for  determining  investment  levels  for  initial  stocks  of  spares  to 
support  future  deployments  of  the  weapon  system. 

An  availability  model  is  clearly  a  powerful  tool  for  determining  spares 
investment  levels  once  component-level  data  are  available.  Its  power  lies  in 
the  fact  that  it  makes  visible  the  availability-vs . -cost  relationship; 
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however,  the  F-16  experience  points  out  a  possible  pitfall  associated  with  the 
use  of  initial  estimates  of  component  characteristics.  As  discussed  earlier, 
component  prices  seem  to  have  been  estimated  satisfactorily,  but  maintenance 
factors  were  not.  For  other  weapon  systems,  the  quality  of  the  initial  esti¬ 
mates  might  be  very  different.  For  this  reason,  as  much  other  information  as 
may  be  available  should  be  used  in  conjunction  with  availability-vs . -cost 
curves  in  reaching  investment  decisions.  For  example,  the  accuracy  of  the 
curve  should  be  verified  intuitively  by  computing  the  implied  cost  for,  say, 
90  percent  availability  and  viewing  it  as  a  percentage  of  end-item  cost  to  see 
if  it  is  consistent  with  past  experience  on  other  weapon  systems  that  had  high 
initial  availability.  Additional  intuition  about  the  accuracy  of  the 
availability-vs . -cost  curve  can  be  gained  simply  by  comparing  the  system-level 
reliability  to  the  reliability  implied  by  the  component  maintenance  factors. 
In  the  F-16  case  General  Dynamics,  in  [5],  recommended  that  a  mean  flying  time 
between  failures  (MFTBF)  of  2,9  be  included  in  the  weapon-system  specifica¬ 
tion.  This  is  roughly  consistent  with  the  MFTBF  of  5.82  that  was  actually 
observed  on  the  810  items  during  the  period  1  January  1979  -  30  June  1981. 
That  is,  the  MFTBF  of  2.9  proposed  by  General  Dynamics  is  consistent  with  an 
allocation  to  the  810  recoverable  components  peculiar  to  the  F-16  of  roughly 
half  of  the  total  failures  on  the  aircraft.  This  seems  reasonable  to  us. 
However,  a  calculation  of  the  aircraft  MFTBF  using  the  estimated  (ORLA)  main¬ 
tenance  factors  yields  an  MFTBF  of  1.45.  Taking  into  account  the  approxi¬ 
mately  1200  common  recoverables  and  all  of  the  consumables  would  imply  an 
estimated  MFTBF  well  below  1.0.  Thus,  some  very  simple  arithmetic  applied  to 
the  ORLA  maintenance  factors  would  have  strongly  suggested  that  they  were,  on 
the  average,  greatly  inflated.  (To  say  inflated  by  a  factor  of  four  would  be 
a  bit  presumptuous  given  our  hindsight;  nevertheless,  that  is  exactly  what  the 
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arithmetic  would  have  suggested  even  in  1977.)  Note  that  all  of  this  dis¬ 
cussion  ignores  K  factors,  derate  curves,  reliability  growth,  etc.  We  are 
simply  suggesting  that,  when  an  availability-vs . -cost  curve  is  used  to 
determine  a  spares  investment  level  prior  to  the  availability  of  operational 
data,  i.e.,  with  initial  estimates  alone,  then  those  estimates  should  be 
corroborated,  at  least  intuitively.  Furthermore,  as  we  demonstrate  in  the 
next  chapter ,  early  operational  data  are  very  useful  in  revising  initial 
estimates;  therefore,  if  such  data  are  available  at  the  time  of  an 
investment-level  decision,  the  use  of  an  availability  model,  supported  by 
initial  estimates  modified  by  the  operational  data ,  would  be  preferable  to  any 
other  strategy  for  determining  the  investment  level. 
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4.  USEFULNESS  OF  EARLY  OPERATIONAL  DATA  IN  REVISING  ESTIMATES 

OF  COMPONENT  CHARACTERISTICS 


In  this  chapter  we  explore  the  application  of  a  well  known,  well  de¬ 
veloped  body  of  theory  known  as  Bayesian  learning  to  the  question  of  how  one 
can  best  use  early  operational  (maintenance)  data  to  revise  initial  estimates 
of  component  characteristics.  In  particular,  we  will  focus  our  attention  on 
the  initial  ORLA  estimates  of  maintenance  factors  and  their  actual  values 
observed  subsequent  to  the  delivery  of  the  first  operational  aircraft.  This 
discussion  applies  to  the  problem  of  computing  spares  requirements  after  some 
early  operational  data  are  available. 

The  theory  of  Bayesian  learning  is  well  known.  Its  application  to  in¬ 
ventory  systems  has  been  discussed  in  [3],  [7],  [8],  and  other  papers.  The 
foundations  of  the  theory  may  be  found  in  [10].  The  interested  reader  is 
referred  to  [9]  for  further  discussion  of  the  theory  and  applications. 

Well  in  advance  of  the  delivery  of  the  first  aircraft,  estimates  are  made 
of  component  characteristics  as  part  of  the  ORLA  process.  These  initial 
estimates,  including  maintenance  factors,  are  matters  of  substantial 
uncertainty.  The  theory  of  Bayesian  learning  suggests  that  it  is  constructive 
to  characterize  one’s  uncertainty  about  the  true  value  of  some  unknown  number 
by  modeling  it  as  a  random  variable  with  a  probability  distribution  that  best 
characterizes  the  uncertainty.  This  probability  distribution  is  called  the 
a  priori  probability  distribution,  or  simply  the  prior. 

Subsequent  to  the  delivery  of  the  first  aircraft,  data  collected  in  the 
Air  Force's  maintenance  data  collection  system  are  helpful  in  determining  the 
true  value  of  the  maintenance  factor.  An  important  question  concerns  the 
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relative  weights  that  should  be  given  to  those  data  and  to  the  ORLA  estimate. 
DoDI  4140.42  suggests  a  simple  scheme  for  weighting  the  estimates  and  data  as 
shown  in  Table  4-1. 

TABLE  4-1.  WEIGHTING  FACTORS  SUGGESTED  BY  DoDI  4140.42 


Elapsed  Time 

Since  Preliminary 
Operational  Capability 

Weighting  Factor 
Initial  Operational 
Estimate  Data* 

6  Mos . 

0.75 

0.25 

1  Yr. 

0.50 

0.50 

18  Mos. 

0.25 

0.75 

2  Yrs . 

0.00 

1.00 

"'These  are  specified  as  minimal  values. 

We  have  observed  a  strong  tendency  among  logisticians  to  view  early 
operational  data  as  having  little  value.  As  we  will  show,  such  data  have 
enormous  utility  in  revising  early  estimates  of  maintenance  factors;  in  fact, 
they  may  be  dramatically  more  useful  than  most  logisticians'  intuition  might 
suggest. 

The  theory  of  Bayesian  learning  specifies  that  the  relative  weighting  of 
the  initial  estimate  and  the  data  is  a  function  of  the  degree  of  uncertainty 
surrounding  the  estimate;  i.e.,  the  more  uncertain  the  decision  maker  is  about 
his  estimate,  the  less  weight  it  is  given.  Thus,  Bayesian  logic  yields  an 
optimal  weighting  of  the  estimate  and  the  data  in  the  sense  that  the  weighting 
is  consistent  with  the  decision  maker's  uncertainty.  In  fact,  however,  no 
actual  "decision  maker"  made  any  statements  regarding  his  uncertainty  about 
the  F-16  estimated  maintenance  factors.  The  question  we  attempted  to  answer 
in  this  analysis  was  whether  one  could  postulate  various  alternative  models  of 
uncertainty  about  the  ORLA  estimates  and  find  one  that  was  "best"  in  the  sense 
that  it  yielded  a  relative  weighting  of  the  initial  ORLA  estimates  and  early 
operational  data  such  that  the  revised  estimates,  when  used  by  an  availability 
model,  resulted  in  a  stockage  posture  that  delivered  the  highest  "actual" 
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availability  for  a  specified  investment  level.  By  "actual"  availability  we 
mean  the  availability  calculated  for  a  stockage  posture  based  on  the  actual 
maintenance  factors  observed  during  the  last  24  months  of  the  30-month  period 
covered  by  the  CDS  data  (see  Chapter  3).  In  other  words,  we  used  various 
amounts  of  data  from  the  first  six  months  to  revise  the  ORLA  estimates,  com¬ 
puted  alternative  stockage  postures  using  an  availability  model  with  various 
alternative  weightings  of  the  ORLA  estimates  and  the  data,  then  used  data  from 
the  last  24  months  to  evaluate  the  stockage  postures.  The  remainder  of  this 
chapter  presents  the  results. 

It  is  important  in  understanding  this  analysis  to  bear  in  mind  the  sys¬ 
tematic  positive  bias  in  the  ORLA  estimates;  they  are,  on  the  average,  four 
times  as  large  as  the  maintenance  factors  observed  during  the  last  24  months 
of  the  30-month  period  examined.  The  effects  of  this  strong  bias  are  seen 
throughout  the  results  presented  here. 

THE  ANALYSIS 

This  analysis  examines  three  fundamental  questions  regarding  the  use¬ 
fulness  of  early  operational  data  in  revising  initial  estimates  of  maintenance 
factors : 

What  is  the  best  probability  model  to  use  to  characterize  the  un¬ 
certainty  surrounding  the  initial  estimate? 

What  is  the  best  technique  to  use  to  revise  the  initial  estimate  with 
observed  data? 

How  much  operational  experience  is  needed  before  revising  the  esti¬ 
mates? 

The  Probability  Model 

Because  of  its  reasonableness,  mathematical  tractability ,  and  other 
characteristics  discussed  in  [10],  we  selected  the  gamma  distribution  as  an 
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appropriate  model  of  uncertainty,  a  choice  widely  reinforced  by  the  liter¬ 
ature.  The  gamma  probability  density  function  (p.d.f  )  has  the  form 


f(x)  = 


r(cO(3L 

,  0  elsewhere. 


Of-1  -x/(3 

x  e  r,0<x<oo 


The  parameters  of  this  distribution  are  or  and  (3.  Its  mean  is  equal  to  crf3  and 

2 

its  variance  is  equal  to  0f(3  ;  therefore,  (3  is  the  vanance-to-mean  ratio.  or 
is  a  shape  parameter.  The  value  of  a  (whether  Of  <  1,  or  =  1,  or  Of  >  1)  de¬ 
termines  the  shape  of  the  p.d.f.  as  shown  in  Figure  4-1.  The  first  step  in 
the  analysis  was  to  examine  systematically  alternative  methods  of  determining 
the  parameters.  Since  the  mean  is  equal  to  or  (3  and  is  fixed  equal  to  the  ORLA 
estimate,  setting  one  parameter  determines  the  value  of  the  other.  We  tried 
constant  values  of  Of  for  all  components,  constant  values  of  (3  for  all  com¬ 
ponents,  and  a  couple  of  mixed  strategies.  For  each  individual  case,  we 
pooled  six  months  of  data  (1  January  1979  -  30  June  1979)  with  the  ORLA  esti¬ 
mates  in  a  manner  consistent  with  the  particular  values  of  a  and  (3  being 
examined;  computed  an  optimal  stockage  posture  with  VARI -METRIC  for  each  of 
three  different  budget  levels,  using  the  revised  estimates  of  the  maintenance 
factors  resulting  from  six  months  of  data  and  the  choice  of  Of  or  (3;  and  pre¬ 
dicted  the  availabilities  that  would  result.  In  this  step,  VARI-METRIC  was 
used  in  its  optimization  mode  to  compute  the  least-cost  mix  of  spares  for  each 
of  the  three  levels  of  investment.  Then  we  computed  the  "actual"  availa¬ 
bilities  for  each  of  those  stockage  postures,  again  using  VARI-METRIC,  this 
time  in  an  evaluative  mode,  based  on  the  actual,  observed  maintenance  factors 
that  were  recorded  during  the  24-month  period  from  1  July  1979  to  30 
June  1981.  The  results  are  shown  in  Table  4-2  (p.  4-6).  In  each  of  the  first 
seven  cases,  Of  is  the  same  for  all  components.  These  results  indicate  that 
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FIGURE  4-1  THE  EFFECTS  OF  THE  SHAPE  PARAMETER 


the  performance  of  a  stockage  posture  computed  under  the  conditions  described 
can  be  expected  to  be  best  with  a  fairly  broad  model  of  uncertainty  i.e.,  with 
a  around  1.0.  Note,  too,  that  for  values  of  a  between  0.8  and  2.0,  the 
"actual"  availabilities  are  virtually  indistinguishable. 

Four  other  cases  of  interest  are  examined  in  Table  4-2.  In  the 
cases  in  which  a  =  1  +  10MF  and  a  -  0.1  +  20MF,  neither  a  nor  (3  are  the  same 
for  all  components.  The  average  ORIA  maintenance  factor  (MF)  was  0.0852; 
therefore,  the  case  in  which  a  =  1  +  10MF  involved  average  values  of  a  and  (3 
of  1.852  and  0.046,  respectively,  and  in  the  case  in  which  a  =  0.1  +  20MF,  the 
average  a  and  |3  were  1.804  and  0.047,  respectively.  Although  these  average 
values  appear  quite  close  to  each  other,  they  may  be  misleading.  Table  4-3 
shows  more  clearly  how  different  the  two  cases  are.  The  case  in  which  a  =  0.1 
+  20MF  yields  a  substantially  more  heterogeneous  mix  of  values  of  a. 


The  last  two  cases  in  Table  4-2  involve  fixed  values  of  (3  for  all 


components.  The  case  in  which  a  =  50MF  results  in  a  value  of  f3  =  0.02,  and 


where  a  —  1Q0MF,  {3  =  0.01.  The  resultant  average  values  of  a  for  these  two 

cases  are  4.26  and  8.52,  respectively. 

TABLE  4-2.  PREDICTED  VS.  "ACTUAL"  AVAILABILITIES  FOR  SEVERAL 
ALTERNATIVE  VALUES  OF  a  USING  BAYESIAN  REVISION 


AND  SIX 

$20M 

MONTHS  OF  DATA 

$30M 

$40M 

a 

Pred 

Act 

Pred 

Act 

Pred 

Act 

0.5 

41.98 

70.67 

68.41 

88.23 

86.59 

95.43 

0.8 

39.99 

72.95 

67.48 

89.53 

86.58 

96.15 

1.0 

39.29 

72.94 

66.89 

89.83 

86.64 

95.89 

1.5 

37.71 

73.10 

66.26 

89.89 

86.95 

95.40 

2.0 

36.62 

73.01 

65.80 

89.86 

87.18 

95.59 

5.0 

33.50 

70.22 

64.90 

87.88 

88.13 

93.22 

10.0 

31.47 

66.61 

64.47 

86.43 

88.97 

92.64 

1  +  10MF 

28.99 

71.06 

59.18 

89.55 

83.77 

96.46 

i.l  +  20MF 

23.93 

69.58 

53.57 

88.68 

74.36 

97.93 

50MF 

22.12 

64.69 

54.24 

86.29 

82.00 

96.65 

100MF 

22.75 

61.16 

57.15 

83.92 

85.57 

95.21 

4-6 


TABLE  4-3.  BEHAVIOR  OF  THE  SHAPE  PARAMETER 
AS  A  FUNCTION  OF  THE  MAINTENANCE  FACTOR 


ITEM 

MF 

RESULTANT 

VALUE  OF  a 

a  =  1  +  10MF 

a  =  0. 1  +  20MF 

0.005 

1.05 

0.2 

0.05 

1.5 

1.1 

0.5 

6.0 

10.1 

The  stockage  postures  in  each  of  the  last  four  cases  in  Table  4-2 
perform  relatively  more  poorly  at  lower  budget  levels  than  those  involving 
fixed  values  of  a  between  0.8  and  2.0;  moreover,  the  predicted  availabilities 
are  even  worse  estimates  of  the  "actual"  availabilities  than  in  the  fixed- 
alpha  cases. 

For  these  F-16  data,  we  would  choose  a  =  1.  This  value  places 
little  weight  on  the  ORLA  estimates  relative  to  the  observed  data  because  it 
represents  relatively  great  uncertainty  about  the  estimates.  It  is  not  clear 
that  0(  =  1  is  universally  the  best  choice  for  all  initial  provisioning  prob¬ 
lems,  but  it  seems  to  us  a  reasonable  one.  Given  our  experience  with  initial 
provisioning  data  we  have  examined  from  other  weapon  systems,  we  believe  that 
the  poor  quality  of  provisioning  data  is  best  characterized  by  a  fairly  broad 
model  of  uncertainty  surrounding  initial  estimates  of  component  character¬ 
istics.  Although  one  might  find  probability  models  involving  a  shape  param¬ 
eter  that  is  a  function  of  the  maintenance  factor  that  could  do  somewhat 
better  given  these  data,  we  are  doubtful  about  the  robustness  of  such  models 
when  applied  to  other  initial  provisioning  problems.  Furthermore,  the  ac¬ 
curacy  of  the  estimated  availabilities  is  also  a  matter  of  importance  in 
choosing  parameters. 

As  Table  4-2  illustrates,  the  Bayesian  strategy  applied  to  the  F-16 
data  results  in  estimated  availabilities  that  are  lower  than  the  "actual" 
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availabilities  in  every  single  case.  Since  the  predictive  capability  of  an 
availability  model  is  obviously  of  concern  in  the  initial  provisioning  prob¬ 
lem,  we  were  motivated  to  examine  techniques  other  than  the  classical  Bayesian 
approach  for  revising  early  estimates. 

The  Revision  Technique 

As  we  pointed  out  previously,  the  F-16  ORLA  estimates  were  very 
heavily  biased.  Of  the  810  ORLA  estimates  examined  in  this  study,  721  were 
higher  than  the  actual  maintenance  factors  observed  during  the  30-month  period 
covered  by  the  CDS  data.  Only  89  of  the  estimates  erred  in  the  other  direc¬ 
tion.  This  systematic  bias  led  us  to  consider  alternative  strategies  for 
revising  the  initial  estimates.  Three  of  those  strategies  involve  the  use  of 
a  linear  correction  factor.  One  of  these  also  involves  partitioning  the  set 
of  components  into  two  subsets  (one  consisting  of  the  components  of  the  fire 
control  and  weapons  delivery  systems).  The  fourth  strategy  was  the  method 
prescribed  by  DoDI  4140.42.  Table  4-4  compares  the  performances  of  these  four 
strategies,  again  with  six  months  of  data,  at  the  $20,  $30,  and  $40  million 
levels  of  investment.  It  also  presents  the  results  of  the  Bayesian  strategy 
for  Of  =  1,  shown  in  Table  4-2.  (We  used  Of  =  1  for  the  other  strategies  as 
well,  except  for  the  DoDI  4140.42  method  to  which  it  is  not  applicable.) 


TABLE  4-4.  EVALUATION  OF  ALTERNATIVE  REVISION  TECHNIQUES 

Availabilities  By  Budget  Level 

Revision  $2QM  $30M  $4QM 


Technique 

Pred 

Act 

Pred 

Act 

Pred 

Act 

DoDI  4140.42 

25.40 

61.92 

63.28 

84.11 

90.99 

93.79 

LIN-BAYES 

66.45 

72.03 

89.20 

85.93 

97.39 

93.41 

BAYES-LIN 

71.01 

77.26 

91.36 

91.15 

98.03 

96.60 

BAYES -LIN (S) 

65.71 

70.85 

88.57 

84.46 

97.09 

92.11 

BAYES 

39.29 

72.94 

66.89 

89.83 

86.64 

95.89 

4-8 


The  method  prescribed  by  DoDI  4140.42  consists  of  assigning  a  weight 
of  0.25  (DoDI  4140.42  specifies  0.25  as  a  minimal  value)  to  the  six  months  of 
observed  data.  Although  it  is  clearly  dominated  by  each  of  the  other  methods 
examined  here,  it  does  surprisingly  well  given  its  simplistic  nature;  in  fact, 
its  performance  in  both  predicted  and  "actual"  availabilities  is  within  the 
range  of  policies  examined  in  Table  4-2  involving  a  purely  Bayesian  strategy. 

The  method  labeled  LIN-BAYES  consists  of  multiplying  every  ORLA 

estimate  by  a  correction  factor  equal  to 

n  /  n 

I  M.  /  I  M. 
i=l  1  /  i=l  1 

/v 

where  =  the  ORLA  estimated  maintenance  factor  of  component  i,  M.  =  the 
observed  maintenance  factor  in  the  six-month  period,  and  n  =  810;  the  result¬ 
ing  value  is  then  subjected  to  Bayesian  revision.  The  original  probability 
model  is  changed  by  multiplying  its  second  parameter,  p  (the  variance-to-mean 
ratio),  by  the  correction  factor. 

The  BAYES-LIN  method,  as  one  might  guess,  performs  the  Bayesian 

revision  first,  and  then  modifies  the  revised  estimate  by  the  correction 

factor  which,  in  this  case,  is  equal  to 

n  /  n 

I  M.  /  I  M.' 
i=l  1  /  i=l  1 

where  =  the  mean  of  the  revised  probability  distribution  of  the  maintenance 
factor  of  component  i  after  the  Bayesian  update.  Again,  the  multiplication  is 
performed  on  the  variance-to-mean  ratio. 

The  BAYES-LIN(S)  method  is  simply  the  BAYES-LIN  method  applied 
separately  to  the  data  from  the  fire  control  and  weapons  delivery  systems  and 
the  data  from  all  the  other  systems.  The  partitioning  was  not  helpful. 
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The  BAYES-LIN  method  clearly  and  dramatically  dominates  every  other 
method,  both  in  its  "actual”  availabilities  at  every  budget  level  and  in  its 
substantially  better  predictive  accuracy.  The  rationalization  for  the  use  of 
the  correction  factor  lies  not  only  in  its  superior  performance,  but  also  in 
the  fact  that,  when  initial  estimates  are  so  strongly  and  systematically 
biased  (as  they  are  in  the  F-16  case) ,  it  uses  information  gained  from  all 
components  to  correct  the  estimate  for  each  individual  component.  Further¬ 
more,  if  the  initial  estimates  are  subject  only  to  random  error  rather  than 
the  strong  bias  observed  here,  then  the  correction  factor  will  be  close  to 
unity  and  will  have  no  effect;  i.e.,  the  BAYES-LIN  method  will  be  virtually 
the  same  as  a  pure,  Bayesian  strategy. 

A  remaining  question  regarding  the  BAYES-LIN  strategy  was  whether  it 
performed  well  for  values  of  alpha  other  than  unity.  Table  4-5  (p.  4-14) 
reproduces  the  data  of  Table  4-2  and  compares  them  with  the  same  data  for  the 
BAYES-LIN  method.  The  data  show  that  the  performance  of  the  method  has  es¬ 
sentially  the  same  sensitivity  to  the  value  of  alpha  as  the  Bayesian  technique 
exhibits.  Thus,  our  choice  of  Of  =  1  is  reinforced. 

When  To  Revise 

Thus  far  we  have  examined  revision  of  initial  estimates  only  with 
six  months  of  operational  data.  In  the  F-16  case,  six  months  corresponds  to 
963.5  flying  hours.  The  last  of  the  three  fundamental  questions  we  examine 
here  is,  "How  much  operational  experience  is  needed  before  revising  the  esti¬ 
mates?"  The  answer  to  this  question  is,  "Astonishingly  little!"  We  believe 
it  is  constructive  at  this  point  to  digress  for  a  moment  and  relate  a  story 
told  by  Professor  Howard  Raiffa  [14:20-21] .  We  quote  verbatim. 

"Professor  Ward  Edwards,  a  psychologist  at  the  (sic)  University 
of  Michigan,  has  investigated  the  intuitive  reactions  of  many 
subjects  to  experimental,  probabilistic  evidence.  In  one  of 
his  experiments  he  poses  the  following  problem. 
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'I  have  two  canvas  book  bags  filled  with  poker  chips.  The 
first  bag  contains  70  green  chips  and  30  white  chips,  and 
I  shall  refer  to  this  as  the  predominantly  green  bag.  The 
second  bag  contains  70  white  chips  and  30  green  chips,  and 
I  shall  refer  to  this  as  the  predominantly  white  bag.  The 
chips  are  all  identical  except  for  color.  I  now  mix  up 
the  two  bags  so  that  you  don't  know  which  is  which,  and 
put  one  of  them  aside.  I  shall  be  concerned  with  your 
judgments  about  whether  the  remaining  bag  is  predominantly 
green  or  not.  Now  suppose  that  you  choose  12  chips  at 
random  with  replacement  from  this  remaining  bag  and  it 
turns  out  that  you  draw  eight  green  chips  and  four  white 
chips,  in  some  particular  order.  What  do  you  think  the 
odds  are  that  the  bag  you  have  sampled  from  is  pre¬ 
dominantly  green? ' 

At  a  cocktail  party  a  few  years  ago  I  asked  a  group  of  lawyers, 
who  were  discussing  the  interpretation  of  probabilistic  evi¬ 
dence,  what  they  would  answer  as  subjects  in  Edwards'  experi¬ 
ment.  First  of  all,  they  wanted  to  know  whether  there  was  any 
malice  aforethought  in  the  actions  of  the  experimenter.  I 
assured  them  of  the  neutrality  of  the  experimenter,  and  told 
them  that  it  would  be  appropriate  to  assign  a  .5  chance  to 
'predominantly  green'  before  any  sampling  took  place. 

'In  this  case,'  one  lawyer  exclaimed  after  thinking 
awhile,  'I  would  bet  the  unknown  bag  is  predominantly  white.' 

'No,  you  don’t  understand,'  one  of  his  colleagues  re¬ 
torted,  'you  have  drawn  eight  greens  and  four  whites  from  this 
bag.  Not  the  other  way  around.' 

'Yes,  I  understand,  but  in  my  experience  at  the  bar,  life 
is  just  plain  perverse,  and  I  would  still  bet  on  predominantly 
white!  But  I  really  am  not  a  betting  man.' 

The  other  lawyers  all  agreed  that  this  was  not  a  very 
rational  thing  to  do  -  that  the  evidence  was  in  favor  of  the 
bag's  being  predominantly  green. 

'But  by  how  much?'  I  persisted.  After  a  while  a  consensus 
emerged:  The  evidence  is  meager;  the  odds  might  go  up  from 
50-50  to  55-45;  but  ' .. .as  lawyers  we  are  trained  to  be 
skeptical,  so  we  would  slant  our  best  judgments  downward  and 
act  as  if  the  odds  were  still  roughly  50-50.' 

The  answer  to  the  question  'By  how  much?'  can  be  computed 
in  a  straight-forward  fashion  (we  do  it  below) ,  and  there  is  no 
controversy  about  the  answer.  The  probability  that  the  bag  is 
predominantly  green,  given  a  sample  of  eight  green  and  four 
white  chips,  is  .964.  Yes,  .964.  This  bag  is  predominantly 
green  'beyond  a  reasonable  doubt. '  This  story  points  out  the 
fact  that  most  subjects  vastly  underestimate  the  power  of  a 
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small  sample.  The  lawyers  described  above  had  an  extreme  reac¬ 
tion,  but  even  my  statistics  students  clustered  their  guesses 
around  .70. 

The  analysis  goes  this  way:  Let  us  denote  the  predomi¬ 
nantly  green  and  white  bags  by  GB  and  WB,  respectively.  We 

then  have  P(GB)  =  .5  and  P(WB)  =  .5.  Let  A  stand  for  the  event 

'eight  greens  and  four  whites,  in  the  particular  order  g  g  w  g 
wggwgwgg'.  (The  particular  order  is  actually  unimpor¬ 
tant;  we  give  this  example  only  for  the  sake  of  concreteness.) 

We  then  have 

P(a|gB)  =  .7  X  .7  X  .3  X  ...  X  .7  =  (.7)8(.3)4, 

P(A|WB)  =  .3  X  .3  X  .7  X  ...  X  .3  =  (.7)4(.3)8. 

Now  from  Bayes’  Theorem,  with  GB  in  place  of  6  WB  in  place  of 
®2>  and  A  in  place  of  R)  (sic),  we  have  1 

p(gbIa)  =  _ i _ P(A  |GB)P(GB) _ 

1  P(A|GB)P(GB)  +  P(A|WB)P(WB) 

=  _ (.7)8(.3)4(.5)  _  „ 

( . 7;  ( .3 j  ( . 5)  +  (.3)8(.7)4(.5) 

Edwards  calls  the  tendency  of  human  subjects  to  resist  changing 
their  a  priori  judgments  of  probabilities  the  conservatism  effect.  It  is  the 
conservatism  effect  that  tends  to  induce  reluctance  in  people  to  place  suf¬ 
ficient  value  on  observed  data.  We  believe  this  anecdote  to  be  especially 
pertinent  to  the  initial  provisioning  problem. 

Figure  4-2  shows  four  availability-vs . -cost  curves  (predicted  avail- 
abilities),  one  based  on  the  ORLA  estimates,  one  based  on  estimates  revised 
with  only  one  month  of  data  (42.9  flying  hours),  one  based  on  estimates  re¬ 
vised  after  six  months  (963.5  flying  hours),  and  one  based  on  "perfect  in¬ 
formation,1'  i.e.,  based  on  the  CDS  data  for  the  24-month  period  from  1  July 
1979  to  30  June  1981.  The  dashed  lines  in  Figure  4-2  portray  "actual11 
availabilities.  The  changes  in  the  predicted  curves  essentially  reflect  the 
cost  of  uncertainty.  Note  the  very  large  predictive  error  of  the  ORLA  curve 
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FIGURE  4-2  IMPROVEMENTS  IN  AVAILABILITY  vs  COST 

USING  BAYES-LIN 


COST  (MILLIONS  OF  DOLLARS) 
*  COST  =  28.1  ,  AVAILABILITY  =  48 


TABLE  4-5 .  COMPARISON  OF  BAYES  VS.  BAYES-LIN  REVISION  TECHNIQUES 


BAYESIAN,  6  MOS 


$20M  $30M  $40M 


a 

Pred 

Act 

Pred 

Act 

Pred 

Act 

0.5 

41.98 

70.67 

68.41 

88.23 

86.59 

95.43 

0.8 

39.99 

72.95 

67  48 

89.53 

86.58 

96.15 

1.0 

39.29 

72.94 

66.89 

89.83 

86.64 

95.89 

1.5 

37.71 

73.10 

66 . 26 

89.89 

86.95 

95.40 

2.0 

36.62 

73.01 

65.80 

89.86 

87.18 

95.59 

5.0 

33.50 

70.22 

64.90 

87.88 

88.13 

93.22 

10.0 

31.47 

66.61 

64.47 

86.43 

88.97 

92.64 

1  +  10MP 

28.99 

71.06 

59.18 

89.55 

83.77 

96.46 

0.1  +  20MF 

23.93 

69.58 

53.57 

88.68 

74.36 

97.93 

50MP 

22.12 

64.69 

54.24 

86.29 

82.00 

96.65 

100MF 

22.75 

6l .  16 

57.15 

83.92 

85.57 

95.21 

BAYES 

-LIN,  6  MOS 

$30M 

$20M 

$40M 

a 

Pred 

Act 

Pred 

Act 

Pred 

Act 

0.5 

64.43 

75.16 

86 . 96 

89.82 

96.10 

96.94 

0.8 

68.84 

77.24 

89.97 

90.50 

97.48 

96.58 

1.0 

71.01 

77.26 

91.36 

91.15 

98.03 

96.60 

1.5 

74.79 

76.93 

93.61 

90.45 

98.74 

96.18 

2.0 

77.42 

76.79 

94.99 

90.09 

99.08 

95.26 

5.0 

84.55 

74.58 

97.76 

88.45 

99.51 

91.83 

1  +  10MF 

81.85 

75.83 

96.84 

91.86 

99.38 

96.00 

0.1  +  20MF 

81.63 

77.66 

96.69 

93.24 

99.33 

98.03 

50MF 

87.57 

73.73 

98.50 

90.25 

100.00 

94.93* 

100MF 

*$39 . 16M 
**$36.50M 

90.49 

70.83 

99.07 

87.17 

100.00 

90 . 05** 

induced  by  the  bias  in  the  ORLA  estimates.  Note,  too,  the  dramatic  improve¬ 


ment  in  availability-vs . -cost  when  only  one  month  of  experience  is  used  to 
revise  the  ORLA  estimates  as  well  as  the  remarkable  improvement  in  predictive 
accuracy.  After  six  months  of  experience,  the  availability-vs . -cost  curve 


moves  substantially  closer  to  the  "perfect"  curve.  The  conservatism  effect 
might  lead  one  to  feel  that  the  effectiveness  of  probability  revision  based  on 
so  few  data  is  counterintuitive  but  the  results  speak  for  themselves. 
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The  lesson  here  is  clear  and  compelling.  If  there  ever  is  need  to 
compute  spares  requirements  in  a  weapon-system  acquisition  program  when  opera¬ 
tional  data  are  available,  however  sparse,  one  should  revise  initial  estimates 
prior  to  the  computation.  The  Bayesian  method  explicitly  accounts  for  the 
paucity  of  data  in  the  methodology  used  in  the  revision.  It  is  a  powerful 
technique  and  should  be  used  whenever  any  operational  data  are  available. 


4-15 


5.  CONCLUSIONS  AND  RECOMMENDATIONS 


Several  important  conclusions  emerge  from  this  analysis.  In  this  final 
chapter,  we  present  those  conclusions,  suggest  ways  in  which  the  DoD  can  move 
toward  improved  initial  provisioning  strategies,  and  recommend  actions  that  we 
believe  would  enhance  the  cost-effectiveness  of  initial  provisioning  through¬ 
out  the  DoD. 

CONCLUSIONS 

This  work  focused  on  four  issues  involved  in  a  spares  acquisition 
strategy:  (1)  estimation  of  component  characteristics,  (2)  determination  of 
spares  investment  levels,  (3)  computation  of  spares  requirements,  and  (4)  use¬ 
fulness  of  early  operational  data  in  revising  initial  estimates  of  component 
characteristics.  The  F-16  case  provides  statistical  evidence  on  each  of  these 
issues . 

Estimation  of  Component  Characteristics 

We  examined  estimates  of  maintenance  factors  and  unit  costs  for  the 
F-16  and  compared  those  estimates  with  observed  values.  We  found  that  mainte¬ 
nance  factor  estimates  for  810  recoverable  components  peculiar  to  the  F-16 
were  high  and  unit  cost  estimates  were  remarkably  accurate  on  a  random  sample 
of  20  SAIP  items. 

In  retrospect,  we  think  that  the  pessimistic  maintenance  factors 
reflect  the  natural  human  tendency  of  logisticians  who  had  full  knowledge  of 
the  use  to  which  they  would  ultimately  be  put,  i.e.,  as  a  basis  for  spares 
requirements  computations.  It  was  clear  to  us  that  the  Air  Force  personnel 
who  made  the  initial  ORLA  estimates  made  a  careful,  thorough,  and  con¬ 
scientious  effort  to  make  sound  judgments  based  on  past  experience,  similar 
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applications,  contractors’  estimates,  and  other  factors.  However,  we  suspect 
that  a  logistician’s  tendency  in  that  situation,  given  the  uncertainty  and  the 
consequences  involved,  would  be  to  make  the  estimates  of  maintenance  factors 
on  the  high  side,  to  avoid  the  outcome  of  providing  inadequate  logistics 
support  to  the  weapon  system.  Thus,  we  have  little  more  to  say  about  the  ORLA 
estimates  except  that  we  judge  that  they  were  made  in  good  faith  on  the  best 
data  available  at  the  time. 

We  cannot  generalize  or  extend  to  other  weapon  systems  our  observa¬ 
tions  about  the  powerful  bias  in  the  F-16  initial  estimates  or  the  remarkably 
accurate  unit  costs  we  observed  on  the  20  randomly  selected  SAIP  items. 
However,  our  observations  (see  Chapter  2)  about  some  of  the  anomalies  in  the 
maintenance  data  and  the  sources  of  error  in  assigning  maintenance  factors  to 
higher  assemblies  certainly  apply  to  any  initial  provisioning  problem. 

Determination  of  Spares  Investment  Levels 

In  a  previous  report  [1],  we  concluded  that  an  availability  model 
would  be  useful  in  determining  the  appropriate  spares  investment  level  for  a 
new  weapon  system  provided  only  that  component-level  data  were  available,  even 
if  those  data  were  only  estimates.  We  reasoned  that  the  availability-vs . -cost 
curve  computed  by  an  availability  model  enabled  the  investment  level  decision 
to  be  made  in  full  light  of  the  weapon-system  availability  that  would  result 
from  any  specified  investment  level.  In  the  F-16  case,  most  of  the  component- 
level  data  were  not  available  until  at  least  a  year  after  the  initial  spares 
investment  decision  was  made.  Moreover,  the  F-16  program  is  typical  of  many 
weapon-system  programs  in  this  sense.  However,  investment- level  decisions 
typically  have  to  be  made  to  size  the  initial  spares  packages  to  be  procured 
for  support  of  additional  deployments  of  the  weapon  system  in  subsequent 
years,  especially  for  large  programs.  The  initial  F-16  data,  when  used  by  an 
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availability  model,  VARI-METRIC,  under  conditions  we  viewed  as  reasonable  and 
defensible,  resulted  in  an  availability-vs . -cost  curve  that  would  have  over¬ 
stated  the  required  investment.  The  cause,  as  we  have  pointed  out,  does  not 
lie  in  the  algebra  of  the  model  but  in  the  strong,  systematic,  positive  bias 
in  the  F-16  ORLA  estimates  of  the  component  maintenance  factors.  As  we  showed 
in  Chapter  3,  the  initial  failure-factor  estimates,  when  viewed  at  an 
aggregate  level,  were  clearly  inconsistent  with  MTBF  goals  for  the  F-16.  We 
conclude,  therefore,  that  when  an  availability-vs . -cost  curve  is  supported  by 
initial  estimates  alone,  as  much  other  information  as  may  be  available  should 
be  used  in  conjunction  with  the  availability-vs . -cost  curve  in  reaching  the 
investment  decision.  Furthermore,  if  there  are  operational  data  available,  we 
would  argue  that  the  use  of  an  availability  model,  supported  by  initial 
estimates  modified  by  the  operational  data ,  would  be  preferable  to  any  other 
strategy  for  determining  the  investment  level. 

Computation  of  Spares  Requirements 

Given  a  specified  investment  level,  it  is  clear  how  best  to  compute 
spares  requirements.  The  availability  model  provides  a  stockage  posture  that 
is  clearly  superior  both  in  its  performance  (availability  delivered)  and  its 
greater  immunity  to  uncertainty. 

This  study  has  reinforced  our  observations  in  [l]  on  this  issue. 
For  any  level  of  investment,  VARI-METRIC  (and  certain  other  spares  optimiza¬ 
tion  models),  with  the  specification  of  a  fairly  broad  prior  (a  =  1 ,  say)  by 
the  user,  will  compute  a  spares  posture  that  will  deliver  substantially 
greater  weapon-system  availability  than  will  a  stockage  posture  computed  in 
accordance  with  AFLCR  57-27.  Furthermore,  the  optimized  stockage  posture  will 
be  more  robust  in  the  face  of  uncertainty.  This  robustness  is  especially 
important  in  the  initial  provisioning  scenario  where  early  estimates  of  com¬ 
ponent  characteristics  are  often  poor. 
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Usefulness  of  Early  Operational  Data 


We  conclude  that  early  operational  data  are  dramatically  more  useful 
in  revising  initial  estimates  of  maintenance  factors  than  one's  intuition 
might  suggest.  Postponing  revisions  until  the  end  of  the  demand  development 
period  is  an  especially  serious  mistake  because  any  spares  requirements 
computations  made  during  that  period  to  support  future  deployments  could  lead 
to  significant  over-  or  underinvestment  and  to  procurements  of  the  wrong  mixes 
of  spares . 

The  weighting  factors  prescribed  by  DoDI  4140.42,  although  defined 
as  minimal  values,  result  in  stockage  postures  that  are  clearly  inferior  to 
those  computed  using  a  Bayesian  or  "BAYES-LIN"  strategy  (p.  4-8).  Further¬ 
more,  the  strategy  of  giving  full  weight  to  the  data  and  no  weight  to  the 
initial  estimates  after  the  first  two  years  is  a  mistake,  in  part  because  it 
assigns  failure  rates  of  zero  to  items  that  happened  not  to  fail  during  the 
first  two  years. 

After  evaluating  several  revision  strategies,  we  conclude  that  a 
linear  correction  factor,  applied  after  the  Bayesian  revision,  significantly 
improves  the  resultant  set  of  estimates  (p.  4-9).  We  refer  to  this  method  as 
"BAYES-LIN."  It  not  only  provides  the  best  estimates  of  availability,  but 
also  produces  the  highest  availability  for  a  specified  level  of  investment. 
RECOMMENDATIONS 

We  recommend  that  the  ASD(MRA&L): 

a.  Revise  DoDI  4140.42  to  require  the  use  of  availability  models  to  com¬ 
pute  initial  spares  requirements  given  a  specified  level  of 
investment. 

b.  Evaluate  the  "BAYES-LIN"  revision  strategy  on  another  weapon-system 
acquisition  program.  If  it  again  dominates  other  strategies,  then: 

-  Require  the  use  of  the  "BAYES-LIN"  strategy  on  future  systems. 

-  Delete  the  weighting  factors  prescribed  by  DoDI  4140.42. 


5-4 


APPENDIX  A.  THE  VARI -METRIC  MODEL 


The  VARI -METRIC  Model  is  a  multi-echelon  inventory  model.  Component 
failures  are  modeled  as  a  simple  Poisson  process  whose  mean  is  a  random  vari¬ 
able  which  is  distributed  according  to  a  gamma  distribution.  VARI-METRIC  is 
similar  to  other  multi-echelon  inventory  models,  including  the  Air  Force's 
MOD-METRIC  Model,  the  Army's  SESAME  Model  and  LMI ' s  Aircraft  Availability 
Model.  It  calculates  availability  by  computing  the  expected  backorders  (EBOs) 
for  each  component  based  on  its  asset  position.  The  essential  difference  in 
VARI-METRIC  is  that  it  takes  explicit  consideration  of  uncertainty  by  assign¬ 
ing  a  gamma  prior  to  the  initial  estimates  of  component  failure  rates. 
Furthermore,  it  considers  the  correlation  between  demands  and  the  average 
depot  resupply  time  due  to  the  gamma  prior. 

A  listing  of  the  VARI-METRIC  Model  is  provided  here. 


A-l 


910C  **  **  LA61 A/STARS/ SOURCE/ IP /2BMA I NO 1 
920C 


930C  THIS  PROGRAM  USES  THE  FOLLOWING  SUBROUTINES  UNDER  LA61A/LMILIB 

940C  LUMPDGUM 

P50C  BINITGVM 

960C  DLNGAMMA 

970C  DFACTLN 


990C 


lOOOC**** 
1010C 
1 0200 
1030C 
1040C 
1050C 
1060C 
1070C 
1 030 C 
1090 

1 100C**** 
1110 
1120 
1130 
1  140 
1  150 
1  160 
1170 
USD 
1190 
1200 
1210 
1 220 
1230C 
1240 
1250C 
1 26  OC 
1270C 
1280C 
1290C 
1300C 
131 
1 

1 330C**** 
1340C**** 
1350C**** 
1 36  OC  ■**•*■* 
1370C**** 
1 330C**-** 
1 390 C**-** 
1400C**** 
141  OC  **■** 
1 420C**-**- 
1 430C**-** 
1 440C-*-**-* 
1450C**** 
1460 

1470  1 

1480 

1 490  2 

1500 

1510 

1520 

1530 

1540 


THIS  VERSION  OF  VARI-METRIC  IS  SPECIFICALLY  DESIGNED  TO  MODEL 
A  TWO  ECHELON  RESUPPLY  SYSTEM  WITH  1  DEPOT  AND  2  BASES. 

IT  EXPLICITLY  CONSIDERS  THE  FACT  THAT  THE  2  BASES  ARE  NOT 
IDENTICAL.  THE  MODEL  OUTPUTS  A  CURVE  OF  COST  VS.  AVAILABILITY 
AND  A  FILE  WITH  THE  DATA  NECCESSARY  TO  PRODUCE  A  COMPONENT 
SHOPPING  LIST  FOR  ANY  POINT  ON  THE  COST/AVAILABILITY  CURVE. 

THE  AVAILABILITY  IS  PEACETIME  AVAILABILITY  ^OR  THE  MD  OF 
INTEREST.  THIS  IS  A  WEIGHTED  AVERAGE  OVER  ALL  THE  MDS'S. 

THE  MODEL  CAN  HANDLE  ANY  #  OF  MDS'S  BY  INCREASING  MAXMDSS. 
PARAMETER  MAXEBO- 1500*  MAXMDSS-2*  MAXMDSX2*=4*  MXM0NTHS«25 
COMPILER  WON'T  PERMIT  USING  PARAMETER  MAXMDSS  IN  FORMAT  750, 
COMMON /EBO/EBQO' EB0( MAXEBO) *  SVO* SV(MAXEBO ) , NDQUTO* NDOUT( MAXEBO ) 
REAL  BSHARE ( 2 ) *  BPIPE (2) *  Q(2 ) *QM10VERQ(2) *PIPE0VRQ(2) 

REAL  BEBO ( 2 ) * REBO ( 2 ) * TERM  <  2 ) * PCTNA IR ( MAXMDSS ) 

REAL  UHK ( MAXMDSS ) * FLHRLAST ( MAXMDSX2 ) , RNAIRLST ( MAXMDSX2 ) 

REAL  GLCOST< MAXEBO) 

REAL  TFLHRS( MAXMDSS) *  TNAIR ( MAXMDSS) * THI STFLH ( MAXMDSS ) 

REAL  RNAIR ( MXMONTHS*  MAXMDSX2) * FLHR3 ( MXMONTHS* MAXMDSX2 ) 

INTEGER  NB ( 2 )  * IQPA ( MAXMDSS ) *  NRECS ( MAXMDSX2 ) 

INTEGER  JBASE ( MAXMDSX2 ) * KFIRST ( MAXMDSX2) * I GLGTY < MAXEBO ) 

CHARACTER  DATE*5* STARTDAT*5*  STQPDATE*9 , MD*4* MD0FINT*4 
CHARACTER  MDS*7 ( MAXMDSX2 ) * WUC*8« PN*20* SMR*7 
LOGICAL  DEBUG 

SV0=1 . E8 


THE 


BEGIN  RUN.  READ  IN  DATA  ON  THE  #  OF  A/C  AND  THE  FLYING 
HOURS  AT  EACH  BASE  FOR  EACH  MDS. 

K  IS  AN  INDEX  FOR  MDS  AND  BASE.  FOR  EXAMPLE  FOR  2  MDSS 
AND  TWO  BASES*  K  WILL  RANGE  FROM  1  TO  4.  K=lSc2  WILL  BE  FOR 
FIRST  MDS  AND  3&4  WILL  BE  FOR  THE  SECOND.  KFIRST(IMDS)  IS 
THEFIRST  K  FOR  A  PARTICULAR  MDS  (  THE  LAST  WOULD  BE 
KFIRST ( IMDS+1 )-l  . 

MDS ( K )  &  JBASE ( K )  DEFINE  THE  MDS* BASE  COMBINATION  REPRESENTED  BY 

RNAIR ( I  *  K)  &  FLHRS( I  *  K)  ARE  THE  #  A/C  &  FLYING  HOURS  FOR  MDS/BSAE  K 
DURRING  MONTH  I.  RNAIRLST ( K )  IS  THE  #  A/C  FOR  THE  LAST  MONTH  FOR  K. 
TFLHRS  C I MDS )  &TNA IR ( I MDS )  ARE  THE  TOTAL  (SUMMED  OVER  THE  BASES) 

FLYING  HOURS  S<  #  A/C  FOR  THE  LAST  MONTH.  THI STFLH ( I MDS )  IS  ALSO  SUMMED 
OVER  TIME  (THE  TOTAL  HISTORICAL  FLYING  HOURS). 

READ (5*1) MDOF I NT  *  STARTDAT  * STOPDATE 
FORMAT ( V ) 

DECODE ( STARTDAT  *  2 ) MONTHST  *  I YRSTART 
FORMAT ( 12* IX* 12) 

K-l 

NMDSS=1 
KFIRST ( 1 )«1 
TFLHRS (1 )«0. 

T  NA I R ( 1 )=0. 
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1550 

1560 

1570 

15S0  10 

1590 
1600 
1610 
1620 
1630 
1640 
1650 
1660 
1670 
1680 
1690 
1700 

1710  25 

1720 
1730 
1740 
1750 
1760 
1770 
1 780 
1790 
1800 
1810 

1820  80 
1830 

1840  89 

1S50C 
1860 
1870 

1880  90 

1890 

1900 

1910  92 

1920  95 

1930C 

1940C 

1^50 

1960 

1970 

19S0C 

1 9900***+ 

2000C 

20 10C 

2020C 

2030C 

2040C 

2050C 

206 OC 

20 7 OC 

2080 


THISTFLHC 1 >«0. 

READ ( 4 , 1 >LINENO,MD,MDS< 1 > , JBASE< 1 ),NRECS< 1 ) 

GO  TO  25 

FLHRLAST ( K  >  —FLHRS  < I START- 1 +NRECS( K )»K) 

TFLHRS <  NMDSS ) =TFLHRS ( NMDSS ) +FLHRLAST ( K ) 

RNA  I RLST ( K ) -RNA I R ( I START- 1 +NRECS <  K  > ,  K ) 

TNA I R ( NMDSS ) -TNAI R  < NMDSS ) +RNA I RLST  <  K  > 

TQTALAC— TQTALAC+RNAIRLST  <K) 

K-K+l 

READ  <  4 , 1, END-89 )LINENO,MD, MDS <K> , JBASE(K) , NRECS(K) 

I F ( MDS  <  K )  . EQ . MDS  <  K— 1 ) ) GO  TO  25 
NMDSS— NMDSS+ 1 
KF I RST ( NMDSS )  =K 
TFLHRS < NMDSS )=0. 

TNAIR< NMDSS )=0. 

TH I STFLH ( NMDSS ) *0 . 

IF  <  MD. NE. MDOF INT ) STOP  "  BAD  MD” 

READ<  4,  1 ) LINENO, DATE, TEMPNAIR, TEMPFLHR 
DECODE (DATE, 2 > MONTH,  IYR 

I START- 1 +MONTH-MGNTHST+ 1 2*  < I YR- 1 YRSTART ) 

RNA I R ( I ST ART , K ) -TEMPNA I R 
FLHRS  < I START , K ) =TEMPFLHR 

TH I STFLH  <  NMDSS )  =  TH I STFLH ( NMDSS  >  +TEMPFLHR 

I F ( NRECS ( K  > . EQ. 1 > GO  TO  10 

DO  80  I=ISTART+1, ISTART-1 +NRECS ( K ) 

READ ( 4 , 1 ) L I NENO , DATE , RNA I R  < I , K ) , FLHRS ( I , K ) 

TH I STFLH  <  NMDSS  >  =TH I STFLH ( NMDSS  >  +FLHRS ( I , K ) 

CONTINUE 
GO  TO  10 

KFIRST (NMDSS+1 >*K 

DO  90  I MDS- 1, NMDSS 

PCTNA IR ( IMDS  >=TNA IR ( IMDS > /TOTALAC 
CONTINUE 
DO  95  1*1, NMDSS 

WRITE  (6,  92 )  MDS  (  KF  I  RST  (  I  )  ) ,  TNAIR  ( I  ) ,  TFLHRS  (  I  >  ,  THISTFLH  (  I  ) 
FORMAT (  "  MDS,  TNAIR,  TFLHRS,  THISTFLH-  %A7,3F8.0> 

CONTINUE 


BRT =6. 

0ST=14. 

DRT-56. 

THE  ALPHA  PARAMETER  OF  THE  GAMMA  PROIR  FOR  A  PARTICULAR 
COMPONENT,  IS  GIVEN  BY? 

ALPHA=CONSTA+CONSTB*FF 


WHERE, 

FF  IS  THE  COMPONENT  FAILURE  FACTOR. 

READ  CONSTA  Sc  CONSTB 
READ (5, 1 ) CONSTA, CONSTB 


2090C 
2100C 
21 1  OC 
2120C 
2130C 
2140C 


21 50C  ******  ****-*Hfr**********^***********************************-#Hi-**’*’-fr* 
21  60C****##********-**"*-*****'***********-*******-*-*** *******-*********■** 

21 70 C **•*”*•  BEGIN  NEW  COMPONENT.  READ  COMPONENT  CHARACTERISTICS. 

2180  100  READ ( 1 1 , 1 , END-999 ) WUC , PN , SMR , COST , FF , I QP A , BNRTS, CONPCT , PLT 

2190  NREADS-NREADS+1 

2200  DEBUG-. F. 


2210  ALPHA=CONSTA+CGNSTB*FF 

2220c 


2230C*^**  COMPUTE  PIPELINES  AND  PRORATING  FACTORS. 


2240 

2250 

2260 

2270 

2280 

2290 

2300 

2310 

2320 

2330C 

2340 

2350C 

2360 

2370 

2380 

2390 

2400 

2410  120 

2420C 


DRPCT=*BNRTS*<  1-CONPCT) 

BRPCT  * 1 . —BNRTS 

I F ( BNRTS . LE. 0. ) BRPCT= 1 . -CONPCT 
TC0NPCT=1 . -DRPCT-BRPCT 
BSHARE ( l)-0. 

BSHARE ( 2 ) =0 . 

RIP*0. 

TI=0. 

RIPHIST=0. 

DO  140  IMDS— 1 1 NMDSS 

DO  120  K=KFIRST( IMDS) ,KFIRST< IMDS+1 >-l 
R I PT=FLHRLAST ( K ) * I QP A ( I MDS ) 
RIP=RIP+RIPT 

BSHARE ( JBASE ( K > ) -BSHARE  C JB ASE ( K ) ) +R I PT 
T I  *T  I +RNA I RLST  (  K  )  *■  I QPA  <  IMDS) 

CONTINUE 


2430C****  RIPHIST  IS  THE  TOTAL  HISTORICAL  COMP.  FLYING  HRS, 
2440  RIPHIST=RIPHIST+THISTFLH< IMDS)*IQPA< IMDS) 

2450  140  CONTINUE 


2460C 


USED  IN  NEGAS  COMP. 


2470C*-***  UHK  IS  A  COMMON  COMPONENT  PRORATING  TERM.  SEE  T.J.  O'MALLEY'S  PAPER 
2480C****  ON  COMMON  COMPONENTS  FOR  AN  EXPLANATION. 

2490  DO  150  I MDS* 1, NMDSS 

2500  UHK ( I MDS  >  =TFLHRS  < IMDS)*TI/ <RI P*TNA I R (  I MDS ) ) 

2510  150  CONTINUE 

2520C 

2530  BSHARE  (  1  )  =BSHARE  (D/RIP 

2540  BSHARE  < 2 ) =BSHARE ( 2 ) /RI P 

2550  I F ( DEBUG ) WRITE ( 6, 1 60 ) BSHARE 

2560  160  FORMAT ("  BSHARE=  " »2F8.4> 

2570  T LA MBDA=R I P+FF/ 3000. 

2530C****  NEGAS  IS  THE  NEGATIVE  ASSET  POSITION  CAUSED  BY  CONDEMNATIONS 
2590C****  DURRING  THE  INITIAL  PROVISIONING  PERIOD. 

2600  NEGAS=FF+RIPHIST*TCONPCT*. 01 +  .  5 

2610  BRPIPE=TLAMBDA*BRPCT*BRT 

2620  DRPI PE=TLAMBDA+DRPCT*DRT 

2630  CONP I PE»TLAMBDA*TC0NPCT*PLT*30 . 

2640  DP I PE=DRP I PE+CONP I PE 

2650  OSP I PE=TLAMBDA+ ( DRPCT+TCONPCT ) *OST 

2660  BOP I PE=OSP I PE+BRP I PE 

2670  I F ( DEBUG ) WRITE (6,  170 ) BRP I  PE , DRP I  PE >  CONP I PE , OSP I  PE, ALPHA 

2680  170  FORMAT ( "  BRP IPE , DRP I PE , CONP IPE , OSPIPE , ALPHA=" , 5F 10. 3) 

2690C 

2700C 

2710C 


2730C****  BEGIN  MARGINAL  ANALYSIS.  THE  NUMBER  OF  SPARES  AT  THE  DEPOT 


274 OC  *■■*+■*• 
2 750 C *** * 
2760C-**** 
2770C**** 
2730C#"**-* 
2 790 C **** 


(NO  IS  THE  OUTER  LOOP.  THE  NUMBER  OF  SPARES  AT  THE  BASES 
(NB)  IS  THE  INNER  LOOP.  NTOT  IS  THE  TOTAL  #  OF  MARGINAL 
SPARES  ALLOCATED.  LUMPD  IS  THE  NUMBER  OF  SACROSANCT  SPARES 
ALLOCATED  (ALL  TO  THE  DEPOT).  FOR  A  PARTICULAR  NTOT,  THE  ND.NB 
COMBINATION  WITH  THE  LOWEST  TOTAL  EBO  IS  SAVED  IN  THE  EBO 
AND  NDOUT  ARRAYS. 


2S00C 


2810C****  INITIALIZE  DEPOT,  COMPUTING  LUMPD,  DEPOTCF ,  AND  DEBO  VARIABLES. 
2S20  CALL  LUMPDGVM(DPIPE, ALPHA 

2830  S<  , LUMPD , DEBO , DREBO , DTERM , DEP0TM2 , DEPOTCF , DOM 1 OVRQ , DP I POVRQ ) 

2840C 


2850C****  START  ND  LOOP. 

2860  TSUNKL=TSUNKL+COST*LUMPD 
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2370 

2880 

2890 

2900 

29 10C 

2920C 

2930 

2940C 

2950 

2960 

2970 

2980C 

2990 

3000C 

3010 

3020C 

3030C 

3040 

3050 

3060 

3070 

3080 

3090 

3100 

3110 


TSUNKN*TSUNKN+COST*N£GAS 

ND=LUMPD 

CALL  SPRAY (99999.  ,£.900,  1+NEBOS) 

NEB0S=0 

====  INITIALIZE  BASE  RESUPPLY  PDF 
200  DO  220  1=1,2 

CALL  B I N I TG  VM  <  DEBO , DEP0TM2 , DEPOTCF , BSHARE ( I ) , BOP I PE 
&  , ALPHA, BP I PE < I ) , Q< I ) , QM10VERQC I ) , PIPEOVRQ< I ) 

li  ,  BEBO  <  I  )  ,  REBO  (  I  )  ,  TERM  (  I  )  ) 

-  NON-UNIFORM  BASE  MOD 

BEBO ( I ) =BEBO  < I ) *BSHARE ( I ) 

220  CONTINUE 

**==  FOR  ALL  REASONABLE  NTOT'S  COMPUTE  EBO  AND  PRINT 
NB ( 1 ) =0 
NB ( 2 ) =0 

EBOTEMP=BEBO  < 1 )+BEB0<2> 

NTOT =ND-LUMPD 

IF ( EBO TEMP. GE. EBO( NTOT ) ) GO  TO  400 
EBO ( NTOT ) =EBOTEMP 
I F ( NTOT . GT . NEBOS ) NEBOS=NTOT 
NDOUT ( NTOT ) =ND 


3120  400 

3130 
3140C* 
3150C* 
3160 
3170 
3180 
3190 
3200 
3210 
3220 
3230 
3240 
3250 

3260  450 

3270 

3280 

3290C 

3300C* 

3310 

3320 

3330C 

3 34 OC -*"*■** 

3350  500 

3360 

3370 

3380 

3390 


I W I N= 1 

IF (REBO (2) . GT.REBO(  1 ) ) IWIN=2 

==  ADD  A  SPARE  TO  NWIN,  DECREMENT  EBOTEMP  AND  UPDATE  EBO  AS  NECC. 
ALSO  UBDATE  REBO  AND  TERM  AT  I WIN. 

REBOTEMP=REBO< IWIN) 

IFCREBOTEMP.LT. l.E-4)G0  TO  500 
NB  (  IWIN)  =NB  (  IWIN)+1 
NT0T=NTQT+1 

BEBO (IWIN) =BEBO (IWIN) -REBOTEMP 

EBOTEMP=EBOTEMP-REBOT  EMP 

IF (EBOTEMP. GE. EBO ( NTOT) )G0  TO  450 

EBO ( NTOT ) =EBOTEMP 

I F ( NTOT . GT . NEBOS ) NEBOS=NTOT 

NDOUT ( NTOT )=ND 

N=NB( IWIN) 

TERM  (  IWIN)  =TERM (  I WI N)  *<  PI PEOVRQ  (  IWIN)  +QM 1 OVERQ (  I  WIN>*<  N-l  >  > /N 
REBO ( IWIN) =REBO ( IWIN)-TERM( IWIN) 

==  IF (EBO  ARRAY  NOT  FULL  CONTINUE  ADDING  SPARES. 

IF ( NTOT . LT. MAXEBO ) GO  TO  400 
DEBUG®. T. 

IF  DREBO  NOT  EXHAUSTED,  INCREMENT  ND  UPDATE  DEBO,  ETC.  tc  CONTINUE 

I F ( DREBO . LT . 1 . E-4 ) GO  TO  600 

DEBO=DEBO-DREBO 

DEP0TM2=DEP0TM2-DEB0-DEB0-DREB0 
DTERM=DTERM* ( DPIP0VRQ+DQM10VRQ*ND ) / ( ND+1 ) 

DREBO* DREBO— DTERM 


3400  ND=ND+1 

3410  I F(ND-LUMPD.LE. MAXEBO )G0  TO  200 

3420  WRITE (6,1)"  ND  EXIT  ON  ” , WUC 


3430C 

3440C 

3450C 

3460C  #**■+*■*■*■**■■*■*■*****■***** ***++*■*■+*■*++*++*+***+++++*+++*++++++++■**++*■* 


3470C«*** 
3480  600 

3490 
3500 
35 1 OC 
3520 


COMPUTE  CONVEX  AVAILABILITY  VS.  DOLLARS. 
QSL0G=0 . 

QNLOG-O. 

NSVS=0 

FIND  IESTART  (WHERE  AVAILABILITY  IS  >  0.  )  . 
I ESTART =0 
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3530 

3540 

3550 

3560  605 

3570  610 

35S0C 

3590C***-* 

3600 

3610 

3620 

3630  620 

3640 

3650 

3660 

3670 

3680 

3690C 

3700C 

371 OC**** 

3 720C  **■*-#■ 

3730 

3740 

3750 

3760C 

3770C* 

3780 

3790 

3800 

3810  640 

3820 

3830C 

3840C* 

3850 

3860 

3870 

3830 

3890 

3900 

391 OC 

3920C* 

3930  650 

3940 

3950 

3960 

3970 

3980 

3990 

4000 

40  IOC 

4020C* 

4030  660 

4040C 


I F  (  EBOO . LE. TI )GQ  TO  610 
DO  605  IESTART=1 ,  NEBOS 

IF <EBO< IESTART ) . LE. TI )G0  TO  610 
CONTINUE 

TSUNK I E*TSUNK I E+ I ESTART*CQST 

COMPUTE  STARTING  AVAILABILITY. 

QSTART-O. 

DO  620  1  =  1,  NMDSS 

QSTART=QSTART+PCTNAIR ( I )*( 1.  HJHK( I >*EBO( IESTART) /TI )**IQPA( I ) 
CONTINUE 

IF (QSTART.GT. .99999)00  TO  700 
GSLOG=ALOG  <  QSTART ) 

QNLOG«QSLOG 

IF< IESTART. GE. NEBOS) GO  TO  700 
I ELAST* IESTART 


LOOP  THROUGH  THE  REST  OF  THE  EBO  ARRAY ,  COMPUTING  AVAILABILITIES 
AND  THE  MARGINAL  IMPROVEMENT/COST,  AND  CONVEX  I FYI NG . 

DO  680  I  E  =  I EST  ART  + 1 ,  NEBOS 

IF (EBO( IE ) . GE. EBO< I EL AST) )G0  TO  680 
QLLOG-QNLOG 

===  COMPUTE  AVAILABILITY. 

QN0W*0. 

DO  640  1*1, NMDSS 

QNOW=QNOW+PCTNAIR( I )*( 1 . -UHK ( I )*EBO ( IE ) /T I )**IQPA( I ) 

CONT I NUE 

QNLOG*ALOG(QNOW> 

**=  COMPUTE  MARGINAL  IMPROVEMENT/COST  AND  ANNEX  TO  ARRAYS. 
NSVS*NSVS+1 

GLCOST <  NSVS ) =COST* (  I E- 1 ELAST ) 

SV ( NSVS ) * ( QNLOG-QLLOG ) /GLCOST ( NSVS ) 

I GLQTY ( NSVS >  =  I E- 1 ELAST 
NDOUT <  NS VS ) =NDOUT (IE) 

I ELAST* IE 

===  CONVEXIFY.  IF  ALREADY  CONVEX,  CONTINUE  TO  NEXT  EBO. 

I F ( SV ( NSVS ) • LT . SV ( NSVS- 1 ) ) GO  TO  660 
NSVOLD=NSVS 
NSVS*NSVS-1 

SUM*SV ( NS VS ) * I GLQTY ( NSVS ) +SV ( NS VOLD ) *  I GLQTY ( NSVOLD ) 

I GLQTY ( NSVS ) = I GLQT Y ( NSVS ) + I GLQTY ( NSVOLD ) 

SV ( NSVS ) =SUM/ I GLQTY ( NSVS ) 

NDOUT ( NSVS ) =NDOUT ( NSVOLD ) 

GO  TO  650 

===  EXIT  IF  Q  NEAR  1. 

IF(GNGW.GT. .99999) GO  TO  700 


4050  680  CONTINUE 


4060C 

4070C 

4080C 

40P0C***++**^*++**++*++++*^****+******************+***+*************’ 
4100C****  NOW  WRITE  COMPONENT  TO  TAPE.  FC  1  CONTAINS  COMPLETE  DATA 
4110C*~*+*  FOR  GENERATING  SHOPPING  LISTS.  FC  2  CONTAINS  (AFTER  SORTING) 
4120C****  THE  AVAILABILITY /COST  CURVE. 

4130  700  NWRI TES=NWRI TES+1 

4140  I F ( QNOW . LT .  0 . 99 ) DEBUG* .  T . 

4150  WRITE ( 1 ) WUC, PN, SMR, COST,NEGAS, LUMPD, FF, IQPA, BNRTS, CONPCT ,PLT 

4160  S<  ,  BRT,  DRT,  OST,  NSVS,  QSLOG,  EBOO,  NDOUTO,  IESTART 

4170  I F ( DEBUG ) WR I TE ( 6 , 750 ) WUC , PN , SMR , COST , NEGAS , LUMPD, FF , I QP A,  BNRTS 

4180  &  , CONPCT , PLT , BRT , DRT , OST , NSVS , QSLOG , EBOO , NDOUTO ,  I E ST ART 
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F9.0 


4190 

4200 

4210 

4220 

4230 

4240 

4250 

4260 

4270 

4280 

4290 

4300 

4310 

4320 

4330 

4340 

4350 

4360 

4370 

4380 

4390 

4400 

44 10C 

4420C 

4430C 

4440C 

4450C 


750  FORMAT ("O  WUC=  ",A8,M  PN=  ”,A14,"  SMR= 
&  NEGAS,LUMPD*  ”,215,”  FF=  ”,F6.3,” 

&  ,  "  BNRTS”  ”,F4.2,''  CONPCT=  ” ,F4.2,” 

S<  ,F4.0,  "  DRT=  "  ,F4.0,  "  OST=  ”,F4.0," 

&  ,  "  QSLOG=  %  El  1.4,"  EBOO-  ”,F8.3,M 
WR I TE  <  2 ) 1 000 . +COST* ( LUMPD+ 1 EST ART ) , QSL OG 
I F ( NSVS. EQ • O ) GO  TO  100 
DO  800  I=1,NSVS 


%A7,”  COST=  % 
IQPA=*  %2<I3>,/ 
PUT*  MiF4. 0, "  BRT 
NSVS=  " ,16,/ 
NDOUTO, IESTART=", 


215 


WRITE* 1 )SV* I ) , I GLQTY ( I ), NDOUT* I ) 
WRITE ( 2 ) SV *  I ) , I GLQTY < I ) *COST 
SOO  CONTINUE 


IF*. NOT . DEBUG ) GO  TO  100 
WRITE*6, 760) 

760  FORMAT* M0  EBO, SV, I GLQTY ,  &  NDOUT  ARRAYS” ) 
WRITE  *  6,  770 ) * EBO < I), I=1,NEB0S) 

770  FORMAT *9F8. 3) 

WRITE *6, 780) * SV *  I ) , I=1,NSVS) 

780  FORMAT (7E1 0.3) 

WRITE *6, 790) < I GLQTY* I ), I=1,NSVS) 

790  FORMAT* 1415) 

WRITE  *  6,  790  )  *  NDOUT  *  I  )  *  I=*1,NSVS> 

GO  TO  100 


4460C 


4490C****  END  LOGIC.  PRINT  FINAL  STATISTICS. 

4500  999  WRITE*6,1)"  NREADS,  NWRI  TES,  TSUNKL »  TSUNKN,  TSUNKI  E="  , 

4510  &  NREADS i NWRI TES >  TSUNKL i TSUNKN,  TSUNKIE 

4520  STOP 

4530  END 
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9300  **  **  LA61 A/SLAY/SOURCE/ VM/LUMPDGVM  11/19/80  BY  FMS 
940C 

950C  THIS  PROGRAM  USES  THE  FOLLOWING  SUBROUTINES  UNDER  LA61 A/LM1LIB 
960C  DFACTLN 
970C  DLNGAMMA 

- - 


990C 

1 000  SUBROUT 1 NE  LUMPDGVM <  DP I PE* ALPHA 

1010  &  , LUMPD * DEBO , DREBO * DTERM * DEPO  TM2 , DEPOTCF , DQM 1 OVRQ  * DP I POVRQ ) 

1020C****  DP I PE  IS  THE  EXPECTED  NUMBER  IN  DEPOT  RESUPPLY. 

1030C****  IF  DP  I  PE  AND  ALPHA  ARE  LARGE  ENOUGH*  SOME  SPARES  CAN  BF 
1040C****  ALLOCATED  THE  DEPOT  WITH  THE  CERTAIN  KNOWLEDGE  THAT  THEY 
1050C****  WILL  NEVER  BE  IDLE.  I.E.  SOME  OF  THE  SPARES  GIVE  AN  EBO 
1060C****  REDUCTION  OF  1.  THE  NUMBER  OF  SUCH  SPARES  IS  LUMPD  AND  THE 

1070C****  MODEL  WILL  ALLOCATE  LUMPD  SPARES  TO  THE  DEPOT  AS  A  SACROSANCT 

1080C****  MINIMUM  STOCK.  IF  DP  I PE  OR  LUMPD  IS  SMALL  LUMPD-O, 

1090C****  DEBO  IS  THE  DEPOT  EXPECTED  BACKORDERS  ( -DP IPE-LUMPD ) 

1100C****  DREBO  IS  THE  EBO  REDUCTION  FOR  THE  ( LUMPD***  1  )  *' TH  SPARE. 


11  IOC****  DTERM  IS  THE  PROB.  THAT  EXACTLY  LUMPD  SPARES  ARE  IN  DEPOT 
1120C****  RESUPPLY.  DEP0TM2  IS  THE  EXPECTED  VALUE  OF  THE  SQUARE  OF  THE 
1130C****  NUMBER  OF  DEPOT  BACKORDERS. 

1140  DQ« 1 . +DP I PE / ALPHA 

1150  DQM10VRQ=(DQ-1. >/DG 

1 160  DP I POVRQ— DP I PE / DQ 

1170  LUMPD* DP I PE -3. *SQRT ( DP I PE*DQ ) 

1130  I F ( LUMPD. LE . 0 ) LUMPD-0 

1190C****  IF  LUMPD>0  GO  TO  BIG  LUMP  PROCESSING 

1200  I F ( LUMPD. NE. 0 ) GO  TO  200 

1210C 

1220C  **"  SIMPLE  CASE 

1230  DEBO=DPIPE 

1240  TRMLOG*-DPIPE 

1250  IF( DQ. GE. 1 . 00001 ) TRMLOG= DP I PE* ( ALOG ( DQ ) / ( 1 . ~DG ) ) 

1260  DTERM=EXP ( TRMLOG ) 

1270  DREBO* 1. -DTERM 

1 280  DEP0TM2=DEB0*DEB0+DP I PE*DQ 


1290C* 

1300 

1310 

1320 

1330 

1340 

1350 

1360 

1370C 

13S0C 

1390C 

1400 


=====  DEBO  >  100  NOT  ALLOWED 
100  IF(DEBO. LE. 100. )G0  TO  999 

DEBO=DEBO-DREBO 

DEP0TM2=DEPQTM2-DEB0— DEBG-DREBO 

DTERM=DTERM* ( DPI POVRQ* DQM 1 QVRQ*LUMPD ) / ( LUMPD* 1 > 
DREBO*DREBO- DTERM 
LUMPD=LUMPD+1 
GO  TO  100 

=====  BIG  LUMP  PROCESSING.  CAN  GET  STICKY. 

===«  IF  DQ  IS  CLOSE  TO  1.  TREAT  AS  A  POISSON 
200  IF(DQ.LE. 1.00001 )G0  TO  500 


141  OC 

1420C 

1430 

1440 

1450 

1460 

1470C 

1480C 

1490 

1500C 

1510C 

1520 

1530 

1540 

1550C 

1560C 


-  ELSE  DO  FULL  NEGATIVE  BINOMIAL. 

I ST ART =LUMPD*LUMPD-DP I PE 
I F  < I START. LE.  0) ISTART=0 
PPOVRQM 1 =ALPHA 
TRMLOG* ( -PPOVRQM 1 ) *ALOG <  DQ ) 

-  GETTING  STICKIER.  IF  ISTART>0  COMPUTE  P(ISTART) 

-  DLNGAMMA  BASED  PROCESSING 

IF ( I  START. EQ. 0>G0  TO  300 

-  COMPUTE  LOG  OF  P  OF  I START 

TRMLOG* TRMLOG* I ST ART* ALOG ( DQM 1 OVRQ ) + 

&  SNGL ( DLNGAMMA ( PPOVRQM 1 + I START ) -DFACTLN ( I START ) 

$<  -DLNGAMMA  (  PPOVRQM  1  )  ) 

-  ITERATE  FROM  ISTART  TO  LUMPD. 


1570 

15S0 

1590 

1600 

1610 

1620C 

1630 

1640 

1650 

1660 

1670C 

1680 

1690 

1700C 

1710C 

1720 

1730 

1740 

1750 

1760 

1770 

1780 

1790 

1800 

1810 

1820 

1830 

1840C 

1850 

1860 

1870 

1880 

1890C 

1900 

191  0C 

1920 

1930 

1940 


300 


DEBO-DP I PE- I START 
DTERM*EXP  <  TRMLOG  > 

DREB0*1 . -DTERM 
DEP0TM2«DP I PE*DQ+DEBO*DEBO 
DO  400  I=ISTART+1,LUMPD 

DEBO-DEBO-DREBO 

DEP0TM2=SDEP0TM2-DEB0— DEBO— DREBO 
DTERM*=DTERM*  ( DQM 1 OVRQ*  (  I  - 1  )  +DP I POVRQ )  / 1 
DREBO=DREBO-DTERM 

400  CONTINUE 

GO  TO  999 

-  DQ  CLOSE  TO  1.  TREAT  AS  POISSON. 

500  1ST  ART — LUMPD+LUMPD— DP I PE 

I F  (  I  ST  ART .  LE .  0  >  I  START»=0 
TRMLGG*-DPIPE 

I F  (  I START . NE . 0 ) TRMLOG=TRMLOG+ 1 START*ALOG ( DP 1 PE  > - 
&  SNGL  ( DFACTLN  (  I  START  >  ) 

DEBG=DPIPE-ISTART 
DTERM=EXP ( TRMLOG ) 

DREB0=1. -DTERM 

DEP0TM2-DPIPE+DEB0*DEB0 

DQM10VRG«0. 

DPIPOVRQ=DPIPE 

DO  600  I  =  I ST ART + 1  * LUMPD 

DEBO=DEBO-DREBO 

DEP0TM2=DEP0TM2-DEBG-DEB0-DREB0 
DTERM=DTERM*DP IPE/ I 
DREBO*=DREBO-DTERM 

600  CONTINUE 

999  I F ( DP IPE . GT . 0 .  ) DEPOTCF* 1 . / ( 1 . + ALPHA/DP I PE  > 

RETURN 

END 
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?80C  ++  *+  LA6 1 A /SLAY/SOURCE/ VM /BIN I TGVM  li/19/80  BY  FMS 
990C 

1 OOO  SUBROUT I NE  B I N I TGVM ( DEBO , DEP0TM2 , DEPOTCF , BSHARE , BOPI PE , ALPHA , 

1010  &  BP I PE , Q , QM 1 0  VERGi , P I PEO VRQ , EBO i REBO » TERM ) 

1020C++++  THIS  SUBROUTINE  INITIALIZES  THE  NEGATIVE  BINOMIAL  PDF  AT  A 
10300**++  BASE.  BP I PE  IS  THE  EXPECTED  NUMBER  IN  RESUPPLY  AT  A  BASE. 

10400**+*  Gi  IS  THE  VARIANCE  TO  MEAN  RATIO  OF  THE  #  IN  RESUPPLY  AT  A  BASE. 

1 0500*++*  REBO  IS  THE  EBO  REDUCTION  FOR  THE  FIRST  SPARE  AT  A  BASE. 

10600*+++  TERM  IS  THE  PROBABILITY  THE  EXACTLY  LUMP  ARE  IN  RESUPPLY  FOR 

10700**++  A  PARTICULAR  BASE.  EBO  IS  THE  TOTAL  WORLDWIDE  EBO  WITH 
1080C+++*  LUMP  SPARES  AT  EACH  BASE  (AND  ND  AT  THE  DEPOT). 

1090C 

1100  EBO=BOPIPE+DEBO 

1110  DDELME AN*DEBO+BSH ARE 

1 120  B1B0PIPE=BSHARE+B0PIPE 

1130  B 1 BOVAR=B 1 BOP I PE* ( 1 . +B1 BOP I PE/ ALPHA) 

1140  BP I PE=B 1  BOP I PE+DDELMEAN 

1  150  BVAR*=B1B0PIPE 

1 1 60  DEPOTV AR=DEP0TM2-DEB0*DEB0 

1170  I F ( DEPOTVAR . LE . 0 . ) GO  TO  100 

1 1 30  DVPP=DEPOTVAR*BSHARE+BSHARE 

1 1 90  DDELVAR*DVPP+DDELMEAN+ ( i . -BSHARE ) 

1 200  DDELCF=DVPP*DEPOTCF /DDELVAR 

1210  B1B0CF-1. /< 1.+ALPHA/B1B0PIPE) 

1 220  BVAR=B 1 BOVAR+DDELVAR+2 . +SQRT ( B 1 BOVAR+DDEL VAR*B 1 BOCF*DDELCF ) 

1230  100  Q*BVAR/ BP I PE 

1240C++++  IF  Q  SMALL  TREAT  AS  POISSON. 


1250 

1260C 

1270C 

1280 

1290 

1300 

1310 

1320 

1330C 

1340C 

1350 

1360 

1370 

1380 

1390 

1400C 


IF(Q.LE. 1.00001 )G0  TO  200 

=====  ELSE  INITIALIZE  FOR  NEGATIVE  BINOMIAL 
PIPE0VRQ=BPIPE/Q 
QM10VERQ=(Q-1. ) /Q 
TERM*Q*+ ( BPIPE/ ( 1 . -Q  > ) 

REBG= 1 . -TERM 
GO  TO  999 

=====  TREAT  AS  POISSON. 

200  P I PEO VRQ=BP I PE 

QM10VERQ«0. 

TERM*EXP( -BPIPE) 

REBO* 1. -TERM 
Q=  1 . 


1410C+***  FINISH 
1 420  999  RETURN 
1430  END 
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980C  ♦♦  *♦  LA6 1 A/LMI LI B/DLNGAMMA  11/18/SO  BY  FMS 
990C 

1000  DOUBLE  PRECISION  FUNCTION  DLNGAMMA <  X ) 

1010C*** 

1020C*****  THIS  FUNCTION  COMPUTES  THE  NATURAL  LOG  OF  GAMMA  OF  X 
1030C*** 

1040  IMPLICIT  DOUBLE  PRECISION(D) 

1050C***  ♦DSIGMA  IS  A  CONSTANT  «LN ( SORT < 2*P I ) ) 

1060 
1070 

1080C*-** 

1090C*** 

1100 
1110 
1 120$r 

1130& 

1140C*** 

1150 
1160 


DATA  DSIGMA/. 91893  85332  04672  74178  DO/ 

I F ( X . LE . 9 . 9 ) PR I NT » "  <♦>  DLNGAMMA  PASSED  SMALL  X~“,X 

♦COMPUTE  VARIOUS  PARTS  NEEDED  FOR  THE  APPROXIMATION 
DPN-DBLECX-l.  ) 

DLNGAMMA  =  ( DPN  +  . 5D0 > ♦DLOG < DPN )  -  DPN  +  DSIGMA 
♦  1. ODO/ < 12.0D0^DPN> 

-  1 . ODO/ ( 360. ODO*DPN*DPN*DPN) 

RETURN 

END 
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980C  *★  ★*  LA61 A/LMILI B/ DFACTLN  BY  MJK 
990C 

1000  DOUBLE  PRECISION  FUNCTION  DFACTLN < N ) 

10 IOC*** 

1020C*****  THIS  FUNCTION  COMPUTES  THE  LOGARITHM  (BASE  E)  OF 
1030C*****  'N'  FACTORIAL. 

1040C*** 

1050  PARAMETER  MAXTBLE*30 

1060  IMPLICIT  DOUBLE  PRECISIONS ) 

1070  DIMENSION  DT ABLE < MAXTBLE ) 

10S0  EQUIVALENCE  < DTABLE < 0 > , DZERO ) 

1090C***  *DSIGMA  IS  A  CONSTANT  *  LN ( SQRT ( 2*P I ) ) 

1100  DATA  DS1GMA/. 91893  85332  04672  74178D0  / 

11  IOC***  *DZERG  IS  THE  LOGARITHM  (BASE  E)  OF  O' 

1120  DATA  DZERO/O. ODO/ 

1 130C***  *DTABLE ( I )  IS  THE  LOGARITHM  (BASE  E)  OF  I! 

1140  DATA  DTABLE/ 

1150  Sc  O.ODO, 

1160  Sc  . 693 147 1805599453 10D0, 

1170  Sc  . 179175946922805500D1, 

1180  Sc  .  31 7805383034794562D1  » 

1190  Sc  . 478749 174278204599D1 > 

1200  Sc  .  6579251212010 10099D1  > 

1210  Sc  .  852516136106541430D1, 

1220  Sc  .  106046029027452502D2, 

1230  Sc  .  1 280 1 82748008 1 4696D2 » 

1240  Sc  .  151044125730755153D2, 

1250  S<  . 17502307845S738S5SD2* 

1260  Sc  .  199672144956618362D2* 

1270  S<  .225521 63853 1234229D2, 

1280  Sc  .25191221 18273868 15D2, 

1290  Sc  .27899271 38384089 16D2» 

1300  Sc  .  3067 1860 1060606723D2, 

1310  Sc  . 335050734501368889D2, 

1320  S<  .  363954452080330536D2  > 

1330  S<  .393398841 87 1994940D2, 

1340  Sc  .  423356 164607534850D2 , 

1350  Sc  .  45380 13889847 69080 D2, 

1360  S<  .  4847  1181 35 1 8352239D2 » 

1370  Sc  .  5 1 6066755677 6437 36D2 » 

1380  Sc  .  547847293981 123192D2, 

1390  Sc  .  58003605222979 1579D2, 

1400  Sc  . 612617017610020020D2, 

1410  Sc  .  64557538627006331 1D2, 

1420  S<  .  67889743137 1 8 15349D2* 

1430  S<  .  7 1 257038967 1 660090D2 , 

1440  Sc  .  746582363488301643D2 

1450  Sc/ 

1460C*** 

1470C*** 

1480 

1490C*** 

1500C*** 

1510 

1520C*** 

1530C*** 

1540 

1550  100 

1560C*** 

15700*** 

1580 
1590 
1600Sc 
1610Sc 


*IF(N  IS  WITHIN  THE  TABLE  LIMITS) 

IF ( <  N. LT. 0 )  .OR.  (N. GT. MAXTBLE) )  GO  TO  100 

★RETURN  TABLE  VALUE 
DFACTLN  =  DT  ABLE  <  N ) 

★ELSE  (USE  STIRLING'S  APPROXIMATION  -  SEE  KNUTH  VOL  1,P  111) 
GO  TO  200 
CONTINUE 

★COMPUTE  VARIOUS  PARTS  NEEDED  FOR  THE  APPROXIMATION 
DPN  *  DBLE ( FLOAT  <  N ) ) 

DFACTLN  =  (DPN  +  . 5D0 ) *DLOG ( DPN )  -  DPN  +  DSIOMA 
+  1 . ODO/ ( 12. ODO*DPN ) 

-  1 . ODO/ ( 360 . ODO*DPN*DPN*DPN ) 
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1 620C*** 

1630C*** 

1640  200 

1650C*** 

1660 

1670 


♦END  IF  <  TABLE  LIMITS  TEST) 
CONTINUE 

RETURN 

END 
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APPENDIX  B 


THE  F- 16  PROGRAM 

We  chose  the  F-16  aircraft  as  a  case  study  for  examining  alternative 
spares  acquisition  strategies  for  a  number  of  reasons.  First,  the  program  is 
recent  and  data  were  available  in  enough  detail  to  support  the  study.  Second, 
the  program  had  been  in  operation  long  enough  to  have  meaningful  maintenance 
data  from  which  we  could  infer  recoverable  spares  demand  rates.  Third,  the 
F-16  program  has  had  the  reputation  of  being  a  well-run  program,  producing 
aircraft  without  substantial  time  delays  and  costly  design  changes.  As  back¬ 
ground  we  will  discuss  the  history  of  the  F-16  program,  the  data  for  F-16 
recoverable  components  excluding  the  engine  and  common  items. 

The  late  1960s  brought  increasingly  complex  and  costly  weapon  systems. 
Because  of  escalating  costs  during  a  time  of  overall  defense  spending  cuts  (in 
constant  dollars),  the  idea  of  a  lightweight  fighter  (LWF)  became  increasingly 
popular.  With  the  lower  cost  of  a  LWF,  more  aircraft  could  be  purchased  for  a 
specified  investment,  and  the  greater  number  of  aircraft  would  enhance  the 
presence,  battle  persistence,  resilience,  and  sortie  rate.  The  LWF  advantages 
were  advocated  to  Congress  as  early  as  1968,  but  it  was  not  until  April  1972 
that  the  LWF  program  got  underway.  At  that  time  the  Air  Force  selected 
General  Dynamics  and  Northrup  to  design  and  test-fly  two  prototypes  each. 

The  LWF  program  included  several  factors  intended  to  provide  a  low-cost, 
timely  fighter  aircraft.  These  factors  included  fixed-price  contracts  for 
design,  production  and  test  flights  of  prototypes,  a  fixed-price,  full-scale 
production  contract,  and  concurrency  of  tasks.  Part  of  task  concurrency 
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involved  an  early  decision  on  initial  provisioning  (IP)  purchases.  Design 
goals  were  set  in  the  areas  of  acceleration,  cruise  speed,  sustained  turning 
radius,  and  radius  of  action.  However,  the  contract  did  not  require  the  air¬ 
craft  to  meet  detailed  specifications  and  placed  an  unusually  large  portion  of 
the  design  and  scheduling  responsibilities  on  the  contractor. 

The  General  Dynamics  prototypes  were  rolled  out  in  December  1973  and 
Northrup’s  in  April  1974.  The  competitive  prototype  approach  was  credited  for 
a  program  with  a  minimum  of  paperwork,  responsive  decision  making,  and  a 
fast-paced  developmental  effort  (22  months  from  contract  to  first  flight, 
compared  with  37  months  for  the  C-5A,  29  months  for  the  F-lll,  and  30  months 
for  the  F-15)  . 

Both  contractors*  aircraft  met  or  exceeded  expected  performance  levels. 
In  September  1974,  the  Department  of  Defense  announced  that  it  would  buy  650 
LWF  for  the  Air  Force.  The  selection  of  the  General  Dynamics  F-16  was  an¬ 
nounced  in  January  1975.  Eight  aircraft  were  tested  during  the  pre-production 
full  scale  development  (FSD)  period  from  July  1975  to  June  1978.  In  October 
1977  the  production  contract  was  awarded.  Figure  C-l  shows  the  major  mile¬ 
stones  for  the  F-16  and  its  initial  provisioning. 

In  the  1970s,  the  Air  Force,  like  the  Navy,  increasingly  emphasized 
reliability  and  maintainability  because  of  the  increasing  cost  of  logistics 
support  (due  to  manpower  and  equipment/ component  cost  escalations).  The  F-16 
program  response  was  design  simplicity.  Of  432  major,  recoverable  components 
on  the  prototype  aircraft,  254  were  identical  to  those  used  in  other  aircraft, 
78  were  only  slightly  modified,  and  the  remaining  100  components  (only  23  per¬ 
cent)  were  new.  The  use  of  existing  components,  among  other  things,  enhanced 
hardware  reliability.  In  addition,  interchangeable  components  were  designed 
to  minimize  tooling  as  well  as  to  reduce  initial  manufacturing  and  spares 
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FIGURE  B-l.  F-16  MILESTONES 
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costs.  Eighty  percent  of  the  main  landing  gear  parts  are  interchangeable  on 
the  F-16  and  only  52  different  types  of  fasteners  (all  standard)  are  used 
(compared  to  250  types,  for  example,  on  the  F-lll). 

The  F-16  FSD  contract  included  a  formal  reliability  plan  derived  from 
MIL-STD-785A.  A  similar  plan  covered  maintainability  efforts.  Reliability 
requirements  were  quantified  for  the  F-16  and  for  its  subsystems  and  equip¬ 
ment.  The  requirements  are  expressed  in  terms  of  mean  flight  time  between 
failures  (MFTBF ) .  MFTBF  is  defined  as  total  flight  time  divided  by  the  total 
number  of  failures  experienced  in  flight  and  on  the  ground.  This  is  an  ex¬ 
pression  of  reliability  performance  from  a  maintenance  viewpoint.  Reliability 
data  are  the  basis  for  the  analysis  of  availability  in  this  report. 
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APPENDIX  C 


AIRCRAFT  MAINTENANCE  ACTION-TAKEN  CODES* 


Code  Description 

A  Bench  checked  and  repaired 

Bench  check  and  repair  of  any  one  item  is  accomplished  at  the 
same  time.  (Also  see  Code  F.) 

B  Bench  checked-serviceable 

(No  repair  required) -item  is  bench  checked  and  no  repair  is 
required. 

C  Bench  checked-repair  deferred 

Bench  check  is  accomplished  and  repair  action  is  deferred.  (See 
Code  F). 

D  Bench  checked-transferred  to  another  base  or  unit 

Item  is  bench  checked  at  a  forward  operating  base,  dispersed 
operating  base  or  enroute  base  and  is  found  unserviceable  and 
transferred  to  a  main  operating  base  or  home  base  for  repair. 
This  code  will  not  be  used  for  items  returned  to  a  depot  for 
overhaul.  This  code  will  also  be  used  when  PME  or  other  equip¬ 
ment  is  sent  to  another  base  or  unit  for  bench  check,  calibra¬ 
tion,  or  repair  and  is  to  be  returned,  and  for  items  forwarded  to 
contractors  on  base  level  contracts. 

1  Bench  checked-NRTS  (Not  Repairable  This  Station-Repair  not 
authorized) 

Shop  is  not  authorized  to  accomplish  the  repair.  This  code  shall 
only  be  used  when  the  repair  required  to  return  an  item  to 
serviceable  status  is  specifically  prohibited  by  current  tech¬ 
nical  directives.  This  code  shall  not  be  used  due  to  lack  of 
authority  for  equipment,  tools,  facilities,  skills,  parts  or 
technical  data. 

2  Bench  checked-NRTS-lack  of  equipment,  tools,  or  facilities 

Repair  is  authorized  but  cannot  be  accomplished  due  to  lack  of 
authorized  equipment,  tools,  or  facilities. 

3  Bench  checked-NRTS-lack  of  technical  skills 

Repair  cannot  be  accomplished  due  to  lack  of  technically  qual¬ 
ified  people. 

*  Reference  [13] 
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Code 


Description 


4  Bench  checked-NRTS-lack  of  parts 

Parts  are  not  available  to  accomplish  repair. 

5  Bench  checked-NRTS-shop  backlog 

Repair  cannot  be  accomplished  due  to  excessive  shop  backlog. 

6  Bench  checked-NRTS-lack  of  technical  data 

Repair  cannot  be  accomplished  due  to  lack  of  maintenance  manuals , 
drawings  etc. ,  which  describe  detailed  repair  procedures  and 
requirements . 

7  Bench  checked-NRTS-lack  of  equipment,  tools,  facilities,  skills, 
parts,  or  technical  data 

Repair  authorized,  but  cannot  be  accomplished  due  to  lack  of 
authorization  to  obtain  or  possess  required  equipment,  tools, 
facilities,  skills,  parts,  or  technical  data. 

8  Bench  checked-return  to  depot 

Returned  to  depot  by  direction  of  system  manager  (SM)  or  item 
manager  (IM).  Use  only  when  items  that  are  authorized  for  base 
level  repair  are  directed  to  be  returned  to  depot  facilities  by 
specific  written  or  verbal  communications  from  the  IM  or  SM:  or 
when  items  are  to  be  returned  to  depot  facilities  for  modifica¬ 
tion  in  accordance  with  a  time  compliance  technical  order  (TCTO) 
or  as  UMR  exhibits. 

9  Bench-checked-condemned 

Item  cannot  be  repaired  and  is  to  be  processed  for  condemnation, 
reclamation  or  salvage.  This  code  will  also  be  used  when  a 
(condemned)  condition  is  discovered  during  field  maintenance 
disassembly  or  repair. 

E  Initial  installation 

Eor  installation  actions  that  are  not  related  to  a  previous 
removal  action  such  as  installation  of  additional  equipment  or 
installation  of  an  item  to  remedy  a  ship-short  condition.  This 
code  will  be  used  only  for  equipment  managed  under  the  advanced 
configuration  management  system.  Reference  T.O.!s  00-20-2-2, 
00-20-2-5  and  00-20-2-7.  Must  be  used  with  How  Mai  Code  799. 
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Code 


Description 


F  Repair 

Not  to  be  used  to  code  T  on-equipment 1  work  if  another  code  will 
apply.  When  it  is  used  in  a  shop  environment,  this  code  will 
denote  repair  as  a  separate  unit  of  work  after  a  bench  check. 
Shop  repair  includes  the  total  repair  manhours  and  includes 
cleaning,  disassembly,  inspection,  adjustment,  reassembly  and 
lubrication  of  minor  components  incident  to  the  repair  when  these 
services  are  performed  by  the  same  work  center.  For  precision 
measurement  equipment,  this  code  will  be  used  only  when  calibra¬ 
tion  of  the  repaired  item  is  required  (see  code  G) . 

G  Repairs  and/or  replacement  of  minor  parts,  hardware  and  softgoods 

(Seals,  gaskets,  electrical  connectors,  fittings,  tubing,  hose, 
wiring,  fasteners,  vibration  isolators,  brackets,  etc.)  Work 
unit  codes  do  not  cover  most  nonrepairable  items,  therefore,  when 
items  such  as  those  identified  above  are  required  or  replaced, 
this  action- taken  code  will  be  used.  When  this  action-taken  code 
is  used,  the  work  unit  code  will  identify  the  assembly  being 
serviced  or  most  directly  related  to  parts  being  repaired  or 
replaced.  For  example,  if  an  electrical  connector  was  repaired 
and  was  attached  to  a  radio  transmitter,  the  work  unit  code  for 
the  transmitter  would  be  used  with  this  action-taken  code.  For 
precision  measurement  equipment  this  code  will  be  used  for  re¬ 
pairs  that  do  not  require  calibration  of  the  repaired  item  (see 
code  F) . 

H  Equipment  checked  -  no  repair  required  (for  ’on-equipment'  work 
only) 

All  discrepancies  which  are  checked  and  found  to  require  no 
further  maintenance  action.  This  code  will  be  used  only  if  it  is 
definitely  determined  that  a  reported  deficiency  does  not  exist 
or  cannot  be  duplicated.  Must  be  used  with  How  Mai  Code  799,  812 
or  948. 

J  Calibrated  -  no  adjustment  required 

Use  this  code  when  an  item  is  calibrated  and  found  serviceable 
without  need  for  adjustment,  or  is  found  to  be  in  tolerance  but 
is  adjusted  merely  to  peak  or  maximize  the  reading.  If  the  item 
requires  adjustment  to  actually  meet  calibration  standards  or  to 
bring  in  tolerance,  use  code  K. 

K  Calibrated  -  adjustment  required 

Item  must  be  adjusted  to  bring  it  in  tolerance  or  meet  calibra¬ 
tion  standards.  If  the  item  was  repaired  or  needs  repair  in 
addition  to  calibration  and  adjustment,  use  code  F. 
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L  Adjust 

Includes  adjustments  necessary  for  safety  and  proper  functioning 
of  equipment  such  as  adjust,  bleed,  balance,  rig,  fit,  reroute, 
seat/reseat,  position/ reposition,  or  actuating  reset  button, 
switch  or  circuit  breaker.  For  use  when  a  discrepancy  or  condi¬ 
tion  is  corrected  by  these  types  of  actions.  If  the  identified 
component  or  assembly  also  requires  replacement  of  bits  and 
pieces  as  well  as  adjustment,  enter  the  appropriate  repair 
action-taken  code  instead  of  L. 

M  Disassemble 

Disassembly  action  when  the  complete  maintenance  job  is  broken 
into  parts  and  reported  as  such.  Do  not  use  for  on-equipment 
work. 

N  Assemble 

Assembly  action  when  the  complete  maintenance  job  is  broken  into 
parts  and  reported  as  such.  Do  not  use  for  on-equipment  work. 

P  Removed 

Item  is  removed  and  only  the  removal  is  to  be  accounted  for.  In 
this  instance  delayed  or  additional  actions  will  be  accounted  for 
separately.  (Also  see  codes  Q,  R,  S,  T,  and  U.)  Do  not  use  for 
off-equipment  work. 

Q  Installed 

Item  is  installed  and  only  the  installation  action  is  to  be 
accounted  for.  (Also  see  codes  E,  P,  R,  S,  T,  and  U.)  Do  not 
use  for  off-equipment  work. 

R  Remove  and  replace 

Item  is  removed  and  another  like  item  is  installed.  (Also  see 

codes  T  and  U.)  Do  not  use  for  of f-equipment  work. 

S  Remove  and  reinstall 

Item  is  removed  and  the  same  item  reinstalled.  (Also  see  codes  T 
and  U.)  Do  not  use  for  off-equipment  work.  Must  be  used  with 
How  Mai  Code  800,  804,  or  805. 

T  Removed  for  cannibalization 

A  component  is  cannibalized.  The  work  unit  code  will  identify 
the  component  being  cannibalized.  Do  not  use  this  code  for 
off-equipment  work.  Must  be  used  with  How  Mai  Code  799. 
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U  Replaced  after  cannibalization 

This  code  will  be  entered  when  a  component  is  replaced  after 
cannibalization.  Do  not  use  this  code  for  off -equipment  work. 
Must  be  used  with  How  Mai  Code  799. 

V  Clean 

Cleaning  is  accomplished  to  correct  discrepancy  and/or  when 
cleaning  is  not  accounted  for  as  part  of  a  repair  action  such  as 
code  F.  Includes  washing,  acid  bath,  buffing,  sand  blasting, 
degreasing,  decontamination,  etc.  Cleaning  and  washing  of  com¬ 
plete  items  such  as  ground  equipment,  vehicles,  missiles  or 
aircraft  should  be  recorded  by  utilizing  support  general  codes. 

X  Test- inspection- service 

Item  is  tested  or  inspected  or  serviced  (other  than  bench  check) 
and  no  repair  is  required.  This  code  does  not  include  servicing 
or  inspection  chargeable  to  support  general  work  unit  codes. 

Y  Troubleshoot 

Time  expended  in  locating  a  discrepancy  is  great  enough  to  war¬ 
rant  separating  the  troubleshoot  time  from  the  repair  time.  Use 
of  this  code  necessitates  completion  of  two  separate  line 
entries,  or  two  separate  forms,  one  for  the  troubleshoot  phase 
and  one  for  the  repair  phase.  When  recording  the  troubleshoot 
time  separate  from  the  repair  time,  the  total  time  taken  to 
isolate  the  primary  cause  of  the  discrepancy  should  be  recorded 
utilizing  the  work  unit  code  of  the  defective  subsystem  or 
system.  Do  not  use  for  off -equipment  work. 

Z  Corrosion  repair 

Includes  cleaning,  treating,  priming  and  painting  of  corroded 
items.  This  code  should  always  be  used  when  actually  treating 
corroded  items,  either  on  equipment  or  in  the  shop.  The  work 
unit  code  should  identify  the  item  that  is  corroded.  Use  support 
general  code  for  painting  or  corrosion  preventive  treatment  prior 
to  an  item  becoming  corroded. 
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APPENDIX  D 


COMPONENT  MAINTENANCE  FACTORS 


Each  of  the  F-16  recoverable  components  used  for  the  analysis  of  this 

report  is  identified  in  the  following  listing  by  work  unit  code  (WUC) .  The 

nomenclature  associated  with  each  WUC  can  be  found  in  [4]  .  On  the  listing 

there  are  several  maintenance  factors  (MF)  associated  with  each  component: 

the  estimated  MF  from  the  ORLA/DORR  process  described  in  Chapter  2 
(ORLA  EST), 

the  MF  computed  using  the  failures  reported  during  the  first  six 

months  of  operation  (January  1979  to  May  1979) (6M  MEAS), 

the  MF  computed  using  the  failures  reported  during  the  first  six 

months  of  operation  to  modify  the  ORLA  estimates  as  prescribed  by  DoDI 
4140.42  (6M  7525), 

the  MF  computed  using  the  failures  reported  during  the  first  six 

months  of  operation  to  modify  the  ORLA  estimates  in  the  Bayesian  sense 
described  in  Chapter  4  (6M  BAYES), 

the  MF  computed  using  the  failures  reported  during  the  first  six 

months  of  operation  to  modify  the  ORLA  estimates  using  the  "BAYES-LIN" 
method  described  in  Chapter  4  (6M  B-L) , 

the  MF  computed  using  the  failures  reported  during  the  last  24  months 
(July  1979  to  June  1981)  of  operation  to  modify  the  ORLA  estimates 
using  the  Baysian  method  described  in  Chapter  3  (24M  'ACT')  and, 

the  MF  computed  using  the  failures  reported  from  January  1979  to  June 
1981  (30M  MEAS) . 

This  listing  shows,  on  a  component-by-component  basis,  the  differences  between 
the  ORLA  estimates  of  MF ,  revised  estimates,  and  the  MF  implied  by  actual 
reported  failures  to  date. 
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ORLA 

6M 

6M 

wuc 

EST 

MEAS 

7525 

1  IAEA 

0 . 2500 

0. 

0. 2500 

1 1  ABB 

0 . 1 000 

0. 

0. 1000 

1 1  ABC 

0 . 1 000 

0. 

0. 1000 

1  1 ACA 

0 . 0080 

0. 

0 . 0080 

11ACB 

0 . 0050 

0. 

0 . 0050 

1 1  ACC 

0. 0050 

0. 

0.0050 

11  ADA 

0 . 0080 

0. 

0. 0080 

1 1 ADB 

0 . 0050 

0. 

0. 0050 

1 1  ADC 

0 . 0050 

0. 

0. 0050 

1  IAEA 

0 . 0050 

0. 

0. 0050 

11CBA 

0.0050 

0. 

0.0050 

1  ICBC 

0. 0040 

0. 

0. 0040 

1 1 CBD 

0 . 0040 

0. 

0.0040 

11CBE 

0 . 0500 

0. 

0 . 0500 

1 1  CCA 

0. 0050 

0. 

0. 0050 

1 1CCB 

0 . 0050 

0. 

0. 0050 

1 1  Cec¬ 

0 . 0050 

0. 

0. 0050 

il  CDA 

0 . 0040 

0. 

0. 0040 

11CDC 

0 . 0050 

0. 

0. 0050 

11  ODD 

0 . 0050 

0. 

0 . 0050 

11  CDF 

0 . 0020 

0. 

0. 0020 

1 1 CDG 

0 . 00 1 0 

0. 

0.0010 

1 1 CDH 

0 . 00 1 0 

0. 

0 . 00 1 0 

1 1 CDK 

0.0010 

0. 

0 . 00 1 0 

11CEA 

0 . 0040 

0. 

0. 0040 

1 1CEB 

0 . 0040 

0. 

0.  0040 

11CED 

0 . 0050 

0. 

0 . 0050 

11  CEE 

0 . 0050 

0. 

0. 0050 

1 1  CEF 

0 . 0050 

0. 

0. 0050 

11CEG 

0 . 0050 

0. 

0.0050 

1  1 CEH 

0 . 0050 

0. 

0. 0050 

11CEJ 

0 . 0050 

0. 

0 . 0050 

11  CEL 

0 . 0050 

0. 

0. 0050 

1 1CEN 

0 . 0040 

0. 

0. 0040 

1 1 CET 

0 . 0050 

0. 

0 . 0050 

1 1EBA 

0 . 0050 

0. 

0. 0050 

11  EBB 

0 . 0050 

0. 

0 . 0050 

1  1EBD 

0 . 0050 

0. 

0 . 0050 

1 1EBE 

0 . 0050 

0. 

0. 0050 

1 1EBH 

0 . 0050 

0. 

0. 0050 

11EBK 

0 . 0050 

0. 

0. 0050 

11EBL 

0 . 0050 

0. 

0. 0050 

1 1EBM 

0 . 0050 

0. 

0 . 0050 

1  1ECA 

0 . 0050 

0. 

0 . 0050 

11ECB 

0 . 0050 

0. 

0. 0050 

1 1ECC 

0 . 0050 

0. 

0. 0050 

1 1ECD 

0.  0050 

0. 

0. 0050 

11ECE 

0 . 0050 

0. 

0. 0050 

1 1 ECF 

0 . 0050 

0. 

0. 0050 

1 1ECH 

0 . 0050 

0. 

0 . 0050 

6M 

6ii 

24M 

30  M 

BAYES 

B-L 

•'ACT-' 

MEAS 

0.0733 

0 . 0496 

0 . 0056 

0.0037 

0.0342 

0.0231 

0.0019 

0. 0009 

0 . 0342 

0.0231 

0. 0009 

0. 

0.0074 

0. 0050 

0 . 00 1 5 

0. 

0 . 0048 

0.0032 

0. 0014 

0. 

0.0048 

0 . 0032 

0 . 00 1 4 

0. 

0 . 0074 

0.0050 

0 . 0030 

0.0018 

0. 0048 

0 . 0032 

0.0014 

0. 

0. 0048 

0.0032 

0.0027 

0 . 00 1 8 

0.0048 

0 . 0032 

0 . 00 1 4 

0. 

0 . 0049 

0 . 0033 

0. 0028 

0. 

0 . 0039 

0. 0026 

0.0013 

0. 

0 . 0039 

0 . 0027 

0. 0064 

0 „ 0080 

0 . 0388 

0 . 0262 

0 . 0 1 63 

0.01 18 

0 . 0049 

0 .0033 

0. 0028 

0. 

0. 0048 

0 . 0032 

0 . 00 1 4 

0. 

0 . 0048 

0.0032 

0. 0014 

0. 

0 . 0039 

0. 0026 

0 . 0038 

0. 0037 

0 . 0048 

0 . 0032 

0 . 00 1 4 

0. 

0 . 0048 

0. 0032 

0. 0014 

0. 

0 . 0020 

0 . 00 1 3 

0.0116 

0 . 0202 

0 . 00 1 0 

0. 0007 

0.0005 

0. 

0 . 00 1 0 

0 . 0007 

0 . 0005 

0. 

0 . 00 1 0 

0 . 0007 

0 . 0007 

0. 

0 . 0039 

0 . 0027 

0 . 00 1 6 

0. 

0 . 0039 

0 . 0027 

0. 0016 

0. 

0 . 0048 

0 . 0032 

0 . 00 1 4 

0. 

0. 0048 

0 . 0032 

0 . 0027 

0. 0018 

0 . 0048 

0 . 0032 

0 . 00 1 4 

0. 

0 . 0048 

0 . 0032 

0 . 00 1 4 

0. 

0 . 0048 

0 . 0032 

0 . 00 1 4 

0. 

0 . 0048 

0 . 0032 

0 . 00 1 4 

0. 

0 . 0048 

0 . 0032 

0 . 00 1 4 

0. 

0 . 0039 

0.0027 

0 . 00 1 6 

0. 

0.0049 

0 . 0033 

0 . 0028 

0. 

0. 0042 

0 . 0028 

0 . 0004 

0. 

0.0046 

0. 0031 

0 . 0008 

0. 

0 . 0048 

0. 0032 

0 . 00 1 4 

0. 

0 . 0048 

0 . 0032 

0 . 00 1 4 

0. 

0 . 0042 

0 . 0028 

0 . 0004 

0. 

0 . 0048 

0 . 0032 

0.0014 

0. 

0 . 0048 

0 . 0032 

0. 0014 

0. 

0. 0048 

0 . 0032 

0 . 00 1 4 

0. 

0 . 0042 

0 . 0028 

0. 0004 

0. 

0. 0046 

0 . 003 1 

0 . 0003 

0. 

0. 0048 

0 . 0032 

0 . 00 1 4 

0. 

0. 0048 

0 . 0032 

0 . 00 1 4 

0. 

0 . 0048 

0 . 0032 

0.0014 

0. 

0. 0048 

0 . 0032 

0.0014 

0. 

0 . 0042 

0 . 0028 

0. 0009 

0 . 0005 
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wuc 

1 1ECJ 
HECK 
1 1ECL 
1 1ECM 
11  EDA 
11  EDO 
11EDD 
UEDH 
1 1  ED  J 
11  EDM 
1 1 EDN 
11EDP 
1 1 EDR 
1 1EDS 
11EDT 
1 1EEA 
1 1EEB 
11  EEC 
1  IEEE 

I  1EEF 
1 1 EEG 
1 1EEH 

I I  EE  J 
1 1EEK 
HEEL 
11EEM 
1 1EEN 
1 1EEP 
11EEQ 
1  1EER 
1 1EEV 
11EEW 
11EEY 
11EEZ 
1 1EFA 
11EFB 
11EFC 
11EFD 
11EFE 
1  1EFF 
11EFG 
1 1EFH 
1 1EFK 
1 1EFL 
1 1EFM 
11EFN 
11EFP 
1 1 GBA 
1 1 GBB 
11GBF 


ORLA 

EST 

0 . 0050 
0 . 0050 
0 . 0050 
0. 0050 
O . 0050 
0. 0050 
0 . 0050 
0. 0050 
0 . 0050 
0 . 0050 
0 . 0050 
0 . 0050 
0 . 0050 
0 . 0050 
0 . 0050 
0 . 0050 
0 . 0050 
0 . 0050 
0 . 0050 
0. 0040 
0 . 0040 
0 . 0050 
0 . 0050 
0 . 0050 
0 . 0050 
0 . 0050 
0 . 0050 
0 . 0050 
0 . 0050 
0 . 0050 
0 . 0050 
O . 0050 
0 . 0050 
0.0050 
0. 0050 
0. 0050 
0 . 0050 
0 . 0050 
0 . 0050 
0 . 0050 
0 . 0050 
0 . 0050 
0 . 0050 
0 . 0500 
0 . 0500 
0 . 0050 
0 . 0050 
0 . 0050 
0 . 0050 
0 . 0050 


6M 

MEAS 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

o. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 


6M 

7525 

0.0050 
0 . 0050 
0.0050 
0. 0050 
0. 0050 
0.0050 
0. 0050 
0 . 0050 
0. 0050 
0. 0050 
0 . 0050 
0. 0050 
0.0050 
0. 0050 
0 . 0050 
0 . 0050 
0. 0050 
0. 0050 
0.0050 
0. 0040 
0. 0040 
0 . 0050 
0. 0050 
0. 0050 
0. 0050 
0. 0050 
0. 0050 
0.0050 
0.0050 
0.0050 
0 . 0050 
0 . 0050 
0. 0050 
O. 0050 
0 . 0050 
0. 0050 
0.0050 
0. 0050 
0. 0050 
0. 0050 
0.0050 
0 . 0050 
0 . 0050 
0. 0500 
0. 0500 
0 . 0050 
0 . 0050 
0. 0050 
0. 0050 
0. 0050 


6M 

BAYES 

0.0048 
0.0048 
0.0048 
0.0048 
0.0048 
0.0048 
0 . 0048 
0. 0048 
0 . 0048 
0 . 0048 
0 . 0048 
0 . 0048 
0. 0048 
0 . 0048 
0 . 0048 
0 . 0049 
0 . 0048 
0.0048 
0. 0048 
0 . 0039 
0. 0039 
0 . 0048 
0 . 0048 
0. 0048 
0.0048 
0.0048 
0. 0048 
0 . 0048 
0 . 0048 
0 . 0048 
0.0034 
0. 0034 
0. 0034 
0. 0034 
0 . 0034 
0 . 0034 
0 . 0034 
0 . 0034 
0. 0034 
0 . 0034 
0. 0048 
0. 0048 
0.0049 
0 . 0388 
0 . 0388 
0 . 0048 
0.0049 
0 . 0048 
0. 0048 
0.0048 


6M 

B-L 

0.0032 
0 . 0032 
0 . 0032 
0.0032 
0.0032 
0 . 0032 
0. 0032 
0 . 0032 
0 . 0032 
0. 0032 
0 . 0032 
0 . 0032 
0.0032 
0 . 0032 
0 . 0032 
0 . 0033 
0 . 0032 
0. 0032 
0. 0032 
0. 0026 
0. 0026 
0. 0032 
0 . 0032 
0.0032 
0. 0032 
0. 0032 
0 . 0032 
0. 0032 
0. 0032 
0 . 0032 
0 . 0023 
0 . 0023 
0 . 0023 
0 . 0023 
0 . 0023 
0 . 0023 
0.0023 
0 . 0023 
0. 0023 
0 . 0023 
0. 0032 
0 . 0032 
0. 0033 
0.0262 
0.0262 
0 . 0032 
0 . 0033 
0. 0032 
O. 0032 
0. 0032 


24M 

•'ACT-' 

0.0027 
0.0014 
0. 0027 
0.0014 
0. 0027 
0. 0041 
0 . 0027 
0.0014 
0.0014 
0 . 00 1 4 
0.0014 
0 . 00 1 4 
0. 0014 
0. 0014 
0.0014 
0 . 00 1 8 
0. 0014 
0. 0014 
0 . 00 1 4 
0.0013 
0 . 0025 
0 . 00 1 4 
0 . 0027 
0.0014 
0. 0014 
0 . 0027 
0 . 00 1 4 
0 . 00 1 4 
0.0014 
0 . 00 1 4 
0. 0002 
0. 0002 
0. 0002 
0. 0002 
0 . 0002 
0. 0002 
0. 0002 
0. 0002 
0. 0002 
0 . 0002 
0 . 00 1 4 
0. 0027 
0. 0028 
0 . 0054 
0. 0109 
0. 0014 
0 . 0028 
0. 0014 
0. 0014 
0. 0014 


SOM 

MEAS 

0 .0018 

0. 

0 . 00 1 8 

0. 

O . 00 1 8 
0.0037 
0. 0018 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 0018 

0. 

0. 0018 

O. 

0. 

0.0018 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0 . 00 1 8 

0. 

0. 

0 . 0059 

O. 

0. 

0. 

0. 

0. 


D-3 


WIJC 

11GBG 
11GBH 
11  GCA 
1 1GCG 
11GCH 
1 1GCK 
1 1GDA 
1 1 GDB 
1 1  GDC 
1 1 GDE 
1 1 GDF 
11GDG 
11GDR 
11GDS 
11GEA 
11GEB 
11GEC 
1 1GED 
1 1GEE 
1 1 GEF 
11GEJ 
1 1GEK 
1 1  GEL 
1 1  GEM 
11  GEN 
1 1GEP 
1 1GEQ 
1 1 GGA 
1 1 GGE 
11GGF 
1 1 GGG 
1 1 GGJ 
1 1 GGK 
11GGL 
1 1GGM 
1 1 GGN 
1 1 GGP 
1 1 JBA 
1 1JBB 
1 1 JBH 
11JBJ 
1 1 JBK 
11JBL 
1 1JBM 
1 1 JC  A 
11  .JOB 
11  LB  A 
1 1LBD 
1 1LBE 
1 1LDA 


ORLA 

EST 

O . 0500 
0 . 0050 
0 . 0050 
0.0500 
0. 0050 
0 . 0050 
0 . 0500 
0 . 0500 
0 . 0050 
0 . 0500 
0.0050 
0.0050 
0 . 0500 
0 . 0500 
0 . 0050 
0 . 0050 
O . 0050 
O . 0050 
0 . 0050 
0. 0050 
0 . 0050 
0 . 0050 
0 . 0050 
0 . 0050 
0 . 0050 
0 . 0050 
0 . 0050 
0 . 0050 
0 . 0050 
0.0050 
O . 0050 
0 . 0050 
0 . 0050 
0 . 0050 
0.0050 
0. 0050 
0.0050 
0 . 0050 
0 . 0050 
0. 0050 
0 . 0050 
0 . 5000 
0 . 0050 
0 . 0050 
0 . 0280 
0. 0010 
0 . 0050 
0 . 0050 
0 . 0060 
0 . 0050 


6M 

ME  AS 

0. 

0. 

0. 

0. 

0. 

0. 

0.2076 

0. 

0. 

0. 

O. 

0. 

o. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 


6M 

7525 

0.0500 
0. 0050 
0. 0050 
0. 0500 
0.0050 
0 . 0050 
0. 0894 
0. 0500 
0. 0050 
0. 0500 
0 . 0050 
0.0050 
0 . 0500 
0 . 0500 
0 . 0050 
0. 0050 
0 . 0050 
0. 0050 
0 . 0050 
O. 0050 
0 . 0050 
O. 0050 
0.0050 
0. 0050 
0. 0050 
0. 0050 
0.0050 
0.0050 
0. 0050 
0. 0050 
0 . 0050 
0. 0050 
0 . 0050 
0. 0050 
0.0050 
0.0050 
0. 0050 
0. 0050 
0. 0050 
0.0050 
0. 0050 
0 . 5000 
0 . 0050 
0 . 0050 
0. 0280 
0 . 00 1 0 
0. 0050 
O. 0050 
0 . 0060 
0.0050 


6M 

BAYES 

0 . 0337 
0 . 0048 
0. 0048 
0. 0337 
0. 0043 
0.0048 
0. 1012 
0.0337 
0.0048 
0 . 0337 
0 . 0048 
0 . 0048 
0. 0337 
0 . 0337 
0 . 0048 
0.0048 
0.0048 
O . 0048 
0 . 0048 
0.0048 
0. 0048 
0. 0048 
0. 0048 
0. 0048 
0. 0048 
0. 0048 
0.0048 
0 . 0048 
0 . 0048 
0 . 0048 
0.0048 
0 . 0048 
0 . 0048 
0 . 0048 
0 . 0048 
0. 0048 
0 . 0048 
0 . 0048 
0 . 0048 
0. 0048 
0.0046 
0 . 0860 
0.0048 
0.0048 
0.0221 
0 . 00 1 0 
0.0048 
0 . 0048 
0. 0057 
0.0048 


6M 

B-L 

0.0228 
0.0032 
0.0032 
0.0228 
0.0032 
0.0032 
0.0684 
0 . 0228 
0.0032 
0. 0228 
0.0032 
0.0032 
0.0228 
0.0228 
0. 0032 
0 . 0032 
0.0032 
0.0032 
O. 0032 
O. 0032 
0. 0032 
0 . 0032 
0 . 0032 
0. 0032 
0. 0032 
0 . 0032 
0 . 0032 
0.0032 
0 . 0032 
0 . 0032 
0 . 0032 
O. 0032 
0 . 0032 
0 . 0032 
0 . 0032 
0 . 0032 
0 . 0032 
0 . 0032 
0.0032 
0.0032 
0.0031 
0. 0581 
0 . 0032 
0 . 0032 
0. 0149 
0. 0007 
0. 0032 
O. 0032 
0 . 0038 
0 . 0032 


24M 

•ACT-' 

0.0018 
0.0014 
O. 0014 
0 . 00 1 8 
0.0014 
0.0014 
0 . 0090 
0.0054 
0.0014 
0.0144 
0. 0027 
0.0014 
0 . 0 1 44 
0.0108 
0 . 0027 
0.0014 
0 . 00 1 4 
0.0014 
0.0027 
0.0014 
0 . 0027 
0. 0014 
0. 0014 
0 . 00 1 4 
0.0014 
0.0014 
0 . 00 1 4 
0.0014 
0 . 00 1 4 
0 . 00 1 4 
0. 0014 
0.0014 
0.0014 
0 . 00 1 4 
0 . 00 1 4 
0 . 00 1 4 
0.0014 
0. 0027 
0 . 00 1 4 
0 . 00 1 4 
0. 0008 
0. 0019 
0.0014 
0.0027 
0.0018 
0.0013 
0 . 00 1 4 
0 . 00 1 4 
0 . 00 1 4 
0 . 0027 


30M 

MEAS 

0. 

0. 

0. 

0. 

0. 

0. 

0.0110 

0 . 0037 

0. 

0. 0128 
0. 0018 

0. 

0.0128 
0 . 0092 
0. 0018 

0. 

0. 

0. 

0 ..  00 1 8 

0. 

0.0018 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

o. 

0. 

0. 

0. 

0. 

0. 

0. 0018 

0. 

0. 

0. 

0. 

0. 

0 . 00 1 8 

0. 

0. 0018 

0. 

0. 

0. 

0.0018 


D-4 


wuc 

1 1LDB 
11LDM 
11LDN 

I  ILEA 
1 1LEB 
11LEF 
1 1LEH 
1 1LEK 
11LFA 
1 1MBA 
11MBE 
1 1MBF 
1 1MCG 
HMD  A 
1 1 MDB 
11MDM 
1 1MDN 

II  ME  A 
1 1MEB 
1 1MEF 
1 1MEH 
11MEK 
12AAA 
12  AAA- 
12AAB 
12AAB 
12AAC 
12AAC 
12AAD 
12AAE 
12AAF 
12AAG 
12  ABA 
1 2ACA 
1 2ACA- 
12ACB 
1 2ACB' 
12ADA 
12ADA 
12ADB 
12ADB 
12AEA 
12AEA 
1 2AEB 
12AED 
12AED 
12AED 
12AEH 
12AFA 
12AFA 


ORLA 

6M 

6M 

6M 

6M 

24M 

SOM 

EST 

MEAS 

7525 

BAYES 

B-L 

'ACT-' 

MEAS 

0.0050 

0. 

0. 0050 

0.0048 

0 . 0032 

0 . 00 1 4 

0. 

0.  0050 

0. 

0 . 0050 

0.0048 

0 . 0032 

0.0014 

0. 

0 . 0050 

0. 

0. 0050 

0 . 0048 

0 . 0032 

0.0014 

0. 

0 . 0050 

0. 

0 . 0050 

0. 0048 

0. 0032 

0.0014 

0. 

0 . 0020 

0. 

0. 0020 

0. 0019 

0. 0013 

0. 0006 

0. 

0. 0050 

0. 

0 . 0050 

0.0046 

0. 0031 

0 . 0008 

0. 

0 . 0050 

0. 

0. 0050 

0.0046 

0 . 003 1 

0 . 0008 

0. 

0 . 0050 

0. 

0 . 0050 

0 . 0046 

0. 0031 

0 . 0008 

0. 

0 . 0050 

0. 

0. 0050 

0.0048 

0 . 0032 

0. 0014 

0. 

0.0050 

0. 

0. 0050 

0. 0048 

0.0032 

0.0014 

0. 

0 . 0060 

0. 

0. 0060 

0 . 0057 

0 . 0038 

0. 0014 

0. 

0 . 0060 

0. 

0. 0060 

0. 0057 

0. 0038 

0 . 00 1 4 

0. 

0 . 0050 

0. 

0. 0050 

0.0048 

0 . 0032 

0.0014 

0. 

0 . 0050 

0. 

0 . 0050 

0 . 0048 

0 . 0032 

0.0014 

0. 

0.0050 

0. 

0 . 0050 

0.0048 

0 . 0032 

0. 0014 

0. 

0 . 0050 

0. 

0.0050 

0. 0048 

0 . 0032 

0. 0014 

0. 

0 . 0020 

0. 

0. 0020 

0. 0020 

0 . 00 1 3 

0. 0019 

0 . 00 1 8 

0. 0050 

0. 

0 . 0050 

0 . 0048 

0 . 0032 

0. 0027 

0 . 00 1 8 

0 . 0020 

0. 

0. 0020 

0. 0019 

0.0013 

0 . 0006 

0. 

0 . 0050 

0. 

0. 0050 

0. 0046 

0. 0031 

0 . 0008 

0. 

0 . 0050 

0. 

0. 0050 

0 . 0046 

0 . 003 1 

0. 00 08 

0. 

0.0050 

0. 

0. 0050 

0.0046 

0.0031 

0 . 0003 

0. 

0 . 0550 

0. 

0. 0550 

0 . 0360 

0. 0243 

0. 0018 

0. 

B 

0.0040 

0. 

0. 0040 

0 . 0039 

0. 0026 

0 . 0024 

0. 

0 . 6200 

0. 

0. 6200 

0 . 0889 

0 . 060 1 

0 . 00 1 9 

0. 

•B 

0 . 0670 

0. 

0. 0670 

0. 0484 

0 . 0327 

0 . 0056 

0. 

1 . 6000 

0. 

1 . 6000 

0 . 0975 

0.0659 

0. 0019 

0. 

•B 

0 . 0670 

0. 

0 . 0670 

0. 0484 

0.0327 

0 . 0056 

0. 

0 . 6200 

0. 

0. 6200 

0. 0889 

0 . 060 1 

0 . 0037 

0 ..  00 1 8 

0. 6200 

0. 

0 . 6200 

0 . 0889 

0 . 060 1 

0.0019 

0. 

0 . 1 000 

0. 

0. 1000 

0 . 0394 

0 . 0266 

0. 0028 

0.  0014 

0. 1000 

0. 

0. 1000 

0 . 0394 

0 . 0266 

0 . 00 1 4 

0. 

0.0150 

0. 

0.01 50 

0 .0131 

0 . 0089 

0 . 00 1 7 

0. 

0 . 0360 

0. 

0. 0360 

0. 0267 

0. 0181 

0.0018 

0. 

B 

0.0018 

0. 

0. 0018 

0. 0018 

0. 0012 

0 . 00 1 4 

0. 

0 . 2000 

0. 

0. 2000 

O ■ 0683 

0. 0462 

0 . 00 1 9 

0. 

B 

0. 1450 

0. 

0. 1450 

0 . 0790 

0 . 0534 

0 . 0058 

0. 

0 . 0360 

0. 

0. 0360 

0. 0267 

0.0181 

0.0018 

0. 

B 

0. 0018 

0. 

0. 0018 

0 . 00 1 8 

0.0012 

0.0014 

0. 

0 . 2000 

0. 

0. 2000 

0 . 0683 

0. 0462 

0 . 00 1 9 

0. 

•B 

0.0218 

0. 

0 .021 8 

0.01 94 

0. 0131 

0. 0048 

0. 

0 . 0360 

0. 

0. 0360 

0. 0316 

0.0214 

0.0025 

0. 

•B 

0 . 0020 

0. 

0. 0020 

0 . 0020 

0. 0013 

0. 0015 

0. 

■B 

0.0410 

0. 

0.0410 

0 . 0332 

0. 0224 

0 . 0053 

0. 

0. 1950 

0. 

0. 1950 

0.  1 110 

0. 0750 

0. 0159 

0 . 0 1 33 

B1 

0. 0300 

0. 

0. 0300 

0 . 0256 

0.0173 

0.0051 

0. 

•B2 

0 . 0 1 SO 

0. 

0 . 0 1 80 

0 . 0 1 63 

0.01 10 

0 . 0046 

0. 

0 . 0080 

0. 

0. 0080 

0. 0071 

0.0048 

0. 0012 

0. 

0 . 0360 

0. 

0.0360 

0.0267 

0.0181 

0. 0018 

0. 

■B 

0 . 00 1 8 

0. 

0. 0018 

0 . 00 1 8 

0 . 00 1 2 

0. 0014 

0. 

D-5 


CO  CO 


wuc 

12AFC 
12AGA 
12AGA 
1 2AGB 
12AGB 
1 2CA0 
12CA0' 
12CAC 
1 2CAC 
1 2C.AG 
12CBA 
1 2CC0 
1 2CC0' 
1  2CEA 
12ZA0 
12ZB0 
12ZC0 
13AAA 
1 3AAC 
1 3AAD 
1 3AAE 
1 3ABA 
13ABB 
1  3ABD 
1  3  ABE 
1 3BAB 
13BAC 
1 3BAC- 
1 3BAD 
13BAF- 
1 3BAF- 
1 3 BAH 
1 3BAJ 
1 3BAK 
1 3BAL 
13BBA 
1 3BBD 
13BBE 
1 3CAA 
1 3CAG 
1 3CAK 
1 3CBA 
1 3CBB 
1 3CBC 
1 3CBF 
13EAA 
13EAB 
13EAC 
1 3EAD 
1 3EAF 


ORLA 

6M 

6M 

6M 

6M 

24M 

30M 

EST 

MEAS 

7525 

BAYES 

B-L 

'ACT'- 

MEAS 

0 . 0002 

0. 

0. 0002 

0 . 0002 

0.0001 

0 . 0002 

0. 

0 . 5500 

0. 

0 . 5500 

0.0873 

0 . 0590 

0.0019 

0. 

•B 

0 . 0620 

0. 

0. 0620 

0 . 0457 

0 . 0309 

0 . 0056 

0. 

0 . 5500 

0. 

0 . 5500 

0 . 0873 

0. 0590 

0 . 00 1 9 

0. 

■B 

0. 0602 

0. 

0 . 0602 

0.0447 

0 . 0302 

0. 0055 

0. 

•A 

0 . 1 300 

0. 

0. 1300 

0 . 0864 

0 . 0584 

0.0105 

0 . 0080 

•B 

0.  1300 

0. 

0 . 1 300 

0.0744 

0.0503 

0 . 0058 

0. 

■A 

0 . 1 280 

0. 

0. 1280 

0. 0855 

0 . 0578 

0 . 0026 

0. 

•B 

0. 1280 

0. 

0. 1280 

0.0737 

0.0498 

0 . 0058 

0. 

0 . 0050 

0. 

0. 0050 

0.0049 

<5 . 0033 

0 . 0028 

0. 

0.0400 

0. 

0. 0400 

0 . 0289 

0 . 0 1 95 

0.0018 

0. 

0.7750 

0. 

0.7750 

0. 1934 

0. 1307 

0.01 34 

0. 0106 

•B 

0. 7750 

0. 

0.7750 

0. 1419 

0 . 0959 

0 . 0060 

0. 

0.0420 

0. 

0. 0420 

0.0361 

0.0244 

0 . 0025 

0. 

0 . 0300 

0. 

0. 0300 

0.0233 

0.0157 

0 . 0053 

0. 0037 

0.0465 

0. 

0. 0465 

0 . 032 1 

0.0217 

0.0072 

0 . 0055 

0 . 2022 

0. 

0 . 2022 

0 . 0686 

0 . 0463 

0.0240 

0 . 0220 

0.0900 

0. 

0. 0900 

0.0482 

0 . 0326 

0 . 0055 

0. 0037 

0.0150 

0. 1038 

0.0372 

0 . 0262 

0.01 77 

0. 0547 

0 . 0605 

0. 0150 

0. 

0 . 0 1 50 

0.0131 

0 . 0089 

0 . 0282 

0 . 0293 

0.0160 

0. 

0.0160 

0.0147 

0. 0099 

0.0221 

0,.  0235 

0. 0050 

0. 

0 . 0050 

0 . 0048 

0. 0032 

0 . 0054 

0. 0055 

0. 0200 

0. 

0 . 0200 

0 . 0 1 68 

0.0113 

0.0051 

0 . 0037 

0.0010 

0. 

0.0010 

0 . 00 1 0 

0 . 0007 

0 . 0052 

0. 0128 

0 . 0050 

0. 

0.0050 

0.0049 

0 . 0033 

0 . 0028 

0. 

0 . 0768 

0.0519 

0 . 0706 

0 . 06 1 9 

0. 0419 

0 . 00 1 8 

0.0018 

■01 

0 . 0060 

0. 

0 . 0060 

0. 0057 

0. 0038 

0.01 00 

0.01 10 

02 

0 . 0060 

0. 

0 . 0060 

0.0057 

0 . 0038 

0 . 00 1 4 

0. 

0 . 0030 

0. 

0. 0030 

0 . 0028 

0 . 00 1 9 

0. 0050 

0 . 0055 

01 

0.0640 

0. 

0.0640 

0 . 0396 

0 . 0268 

0 . 00 1 8 

0. 

02 

0 . 0650 

0. 

0. 0650 

0 . 0400 

0.0270 

0 . 00 1 8 

0. 

0.0150 

0. 

0.0150 

0.0131 

0 . 0089 

0 . 00 1 7 

0. 

0.0160 

0. 

0.01 60 

0.0139 

0. 0094 

0.0017 

0. 

0.0320 

0. 

0.0320 

0 . 0 1 98 

0.0134 

0 . 0009 

0. 
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0 . 0053 
0 . 0035 
0.0137 
0.4152 
0 . 0054 
0. 0171 
0. 0177 
0. 0156 
0. 0263 
0. 01 15 
0. 0151 
0.4437 
0 . 0206 
0.0164 
0 . 0780 
0 . 0222 
0 . 078 1 
0 . 0226 
0. 0197 
0. 1938 
0. 0145 
0. 0046 
0.0053 
O. 0037 
0.0072 
0 . 0092 
0. 0090 
0. 0145 
0. 0091 
0. 0179 
0. 0376 
0 . 00 1 6 
0 . 00 1 8 
0 . 00 1 8 
0 . 00 1 9 
0 . 0037 
0.0019 
0 . 00 1 5 
0 . 0030 
0 . 0008 
0 . 0007 
0. 0018 
0. 0043 
0 . 0052 
0. 0070 
0. 0053 
0. 0017 
O. 0053 
0. 0112 
0.0050 


SOM 

MEAS 

0.0037 
0. 0018 
0.0128 
0.4159 
0 . 0055 
0 . 0202 
O. 0202 
0. 0147 
O. 0312 
0. 0110 
0. 0147 
0. 4387 
0 .021 0 
0  n  0 1 68 

0. 0796 
0. 0224 
0.0755 
0.0210 
0. 0182 
0. 1942 
0. 0128 
0 . 0037 
0. 0037 
0. 0013 
0 . 0055 
0. 0073 
0. 0073 
0.0128 
0 . 0073 
0. 0165 
0 . 0366 
O. 

0. 

0. 

0. 

On  0018 

0. 

0. 

0.0018 

o. 

0. 

0. 

0 . 0037 
0 . 0037 
0 . 0055 
0 . 0037 

0. 

0.0037 
0 . 0092 
0.0037 
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WIJC 

75ADC 

75ADD 

75ADE 

75AFA 

75AFB 

75  AFC 
75AFD 
75BA0 
75BB0 
75BD0 
75CA0 
75CB0 
75DA0 
75DAD 
75DAE 
75DB0 
75DBB 
75DBC 
75DC0 
75DCA 
75DCB 
75DCC 
75DCD 
75DCE 
75DCF 
75BCG 
75DCH 
75DCJ 
75DCM 
75DCS 
75DCT 
75DD0 
75DDB 
75BDC 
75DE0 
75DEB 
75DEC 
75DED 
75DFB 
75EA0 
75EB0 
75EC0 
75ED0 
75EE0 
75EF0 
75EG0 
75EH0 
75EJ0 

76  ADO 
76AE0 


GRLA 

EST 

O. 0200 
0.01 00 
O . 0200 
0.0180 
0.0180 
0.0120 
0 . 0040 
0 . 0690 
0.0070 
0.0010 
0. 2280 
O . 2280 
0. 1460 
0 . 0030 
0 . 0050 
0 . 0290 
0 . 0050 
0.0070 
0 . 6450 
0 . 0050 
0 . 0070 
0.0230 
0 . 0360 
0. 0020 
0.01 00 
0. 0020 
0. 0020 
0 . 0070 
0.0110 
0 . 0030 
0 . 0360 
0. 0370 
0 . 0050 
0 . 0070 
0.0440 
0 . 0050 
0 . 0080 
0.0020 
0. 0050 
0 .0010 
0.0010 
O . 00 1 0 
0 . 0030 
0.0030 
0. 0030 
0 . 00 1 0 
0 . 0030 
0 . 0030 
O . 0220 
0 . 0220 


6M 

MEAS 

0. 

0. 

0. 

0. 

0. 

0 . 1 038 

0. 

0. 0778 

0. 

0.0519 

0. 

0.2595 
0.4548 
0. 0325 

0. 

0. 1557 

0. 

0. 

1 . 4530 
0 . 05 1 9 

0. 

0. 

0. 

0. 2076 
0.0519 

0. 

0. 

0. 

0. 

0. 2076 

0. 

0.0519 

0. 

0. 

0 . 2595 
0.0115 

0. 

0. 

0. 

0.2076 

0. 

o. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 


6M 

7525 

0.0200 
0.0100 
0. 0200 
0.0180 
0.01 80 
0. 0349 
0.0040 
0. 0712 
0. 0070 
0.0137 
0 . 2280 
0.2359 
0.2232 
0. 0104 
0. 0050 
0 . 0607 
0 . 0050 
0 . 0070 
0.8470 
0 . 0 1 67 
0 . 0070 
0 . 0230 
0. 0360 
0. 0534 
0.0205 
0 . 0020 
0 . 0020 
0 . 0070 
0.01 10 
0 . 054 1 
0 . 0360 
0.0407 
0.0050 
0 . 0070 
0 . 0979 
0.0066 
0. 0080 
0 . 0020 
0. 0050 
0 . 0526 
0 . 00 1 0 
0.0010 
0 . 0030 
0 . 0030 
0 . 0030 
0.0010 
0.0030 
0 . 0030 
0.0220 
0. 0220 


6M 

BAYES 

0.0168 
0 . 009 1 
0.01 68 
0.01 53 
O. 0153 
0. 0215 
0.0039 
0 . 0754 
0 . 0066 
0. 0020 
0 . 0233 
0.2563 
0.3597 
0.0055 
0 . 0043 
0 . 0959 
0.0035 
0 . 0055 
1.3410 
0. 0091 
0 . 0062 
0 . 0 1 88 
0.0213 
0. 0096 
0 . 0 1 68 
0 . 00 1 9 
0 . 00 1 9 
0 . 0062 
0 . 009 1 
0 . 0088 
0 . 02 1 3 
0 . 0432 
0. 0035 
0. 0062 
0. 1429 
0. 0070 
0 . 0069 
0 . 00 1 9 
0.0035 
0.0030 
0 . 00 1 0 
0. 0010 
0 . 0029 
0.0029 
O . 0029 
0. 0010 
0 . 0029 
0.0029 
0 . 0 1 82 
0.0164 


6M 

B-L 

0.0113 
0 . 0062 
0.0113 
0.0104 
0.0104 
0.0145 
0.0026 
0.0510 
0.0044 
0 . 00 1 3 
0. 0157 
0 . 1 732 
0.2431 
0 . 0037 
0 . 0029 
0 . 0648 
0.0024 
0.0037 
0.9062 
0 . 0062 
0 . 0042 
0.0127 
0. 0144 
0 . 0065 
0. 0113 
0. 0013 
0 . 00 1 3 
0.0042 
0 . 006 1 
0 . 0059 
0 . 0 1 44 
0 . 0292 
0.0024 
0.0042 
0.0965 
0. 0047 
0 . 0047 
0 . 00 1 3 
0 . 0024 
0 . 0020 
0 . 0007 
0. 0007 
0.0020 
0 . 0020 
0 . 0020 
0. 0007 
0 . 0020 
0.0020 
0.0123 
0.0111 


24M 

'ACT-' 

0.0017 
0.0016 
0. 0017 
0 .0101 
0 . 0034 
0. 0048 
0.0013 
0.0936 
0.0648 
0.0092 
0 . 0563 
0.0498 
0 . 0905 
0.0012 
0 . 0006 
0 . 0408 
0 . 0028 
0.0031 
0 . 8778 
0 . 0 142 
0.01 73 
0.0293 
0 . 0055 
0.0064 
0.0154 
0 .  00 1 9 
0.01 46 
0.0033 
0 . 02 1 5 
0 . 0 1 38 
0 . 0036 
0 . 06 1 0 
0. 0008 
0.01 32 
0.0712 
0 . 00 1 4 
0.0033 
0.0025 
0 . 0004 
0 . 00 1 3 
0. 0013 
0 . 0039 
0 . 0046 
0. 0012 
0. 0046 
0. 0033 
0.0046 
0 . 0035 
0.0017 
0. 0013 


SOM 

MEAS 

0. 

0. 

0. 

0.0092 
0.0013 
0 . 0055 

0. 

0 . 0934 
0. 0788 
0.0174 
0 . 0550 
0.0531 
0. 0978 
0. 0014 
0. 

0.0431 
0 . 0027 
0 . 0028 
0 . 8886 
0.0165 
0. 0183 
O. 0293 
0 . 0046 
0. 01 19 
0.01 65 
0. 0018 
0.0202 
0. 0028 
0 . 0220 
0. 0233 
0. 0028 
0. 0614 
0. 0006 
0.0137 
0.0751 
0 . 00 1 4 
0. 0028 
0 . 0028 
0 . 0002 
0 . 0055 
0.0018 
0 . 0092 
0. 0055 
0. 

0. 0055 
0. 0073 
0.0055 
0 . 0037 

0. 

0. 
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ORLA 

6M 

6M 

wuc 

EST 

MEAS 

7525 

76AL0 

O.OIOO 

0. 

0.0100 

76BA0 

0. 3630 

0.2076 

0.3241 

76CC0 

0.01 00 

0. 

0. 0100 

76DA0 

0 . 0400 

0. 

0. 0400 

76DB0 

0. 1600 

0. 

0. 1600 

76DC0 

0. 1140 

0. 1033 

0.1114 

76DD0 

0.0610 

0. 

0.0610 

76DE0 

0.0140 

0. 

0.0140 

76DG0 

0. 1300 

0. 

0. 1300 

76DH0 

0. 1300 

0. 

0. 1300 

NREADS= 

810 

4 


6M 

6M 

24M 

SOM 

BAYES 

B-L 

-ACT-' 

MEAS 

0.0096 

0.0065 

0. 0021 

0. 

0.2421 

0 . 1 636 

0.0663 

0.0673 

0. 0091 

0. 0062 

0.0047 

0.0037 

0.0239 

0. 0195 

0.0071 

0 . 0055 

0.0630 

0 . 0425 

0.0018 

0. 

0. 1037 

0.0734 

0.0165 

0.0165 

0. 0280 

0. 0190 

0 . 0009 

0. 

0.0123 

0 . 0083 

0. 0049 

0.0037 

0.0577 

0 . 0390 

0. 0013 

0. 

0.0577 

0.0390 

0 . 0037 

0 ..  00 1 8 
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